Jul 28 16:13:19 devstack cinder-volume[77321]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 16:13:19 devstack cinder-volume[77321]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 16:13:19 devstack cinder-volume[77321]: we strongly recommend against using it for new projects. Jul 28 16:13:19 devstack cinder-volume[77321]: If you are already using Eventlet, we recommend migrating to a different Jul 28 16:13:19 devstack cinder-volume[77321]: framework. For more detail see Jul 28 16:13:19 devstack cinder-volume[77321]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 16:13:19 devstack cinder-volume[77321]: import eventlet # noqa Jul 28 16:13:22 devstack cinder-volume[77321]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 16:13:22 devstack cinder-volume[77321]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 16:13:22 devstack cinder-volume[77321]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 16:13:22 devstack cinder-volume[77321]: INFO dbcounter [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Registered counter for database cinder Jul 28 16:13:22 devstack cinder-volume[77321]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77321) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:13:23 devstack cinder-volume[77321]: DEBUG dbcounter [-] [77321] Writer thread running {{(pid=77321) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 16:13:23 devstack cinder-volume[77321]: INFO cinder.rpc [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 16:13:23 devstack cinder-volume[77321]: INFO cinder.rpc [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 16:13:23 devstack cinder-volume[77321]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77321) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:13:23 devstack cinder-volume[77321]: INFO cinder.volume.manager [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Determined volume DB was empty at startup. Jul 28 16:13:23 devstack cinder-volume[77321]: DEBUG cinder.volume.manager [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77321) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 16:13:23 devstack cinder-volume[77321]: INFO cinder.volume.manager [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 28 16:13:23 devstack cinder-volume[77321]: WARNING stevedore.named [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 16:13:23 devstack cinder-volume[77321]: WARNING castellan.key_manager [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 16:13:23 devstack cinder-volume[77321]: WARNING cinder.keymgr.conf_key_mgr [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 16:13:23 devstack cinder-volume[77321]: DEBUG cinder.volume.drivers.lvm [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77321) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 28 16:13:23 devstack cinder-volume[77321]: DEBUG oslo_concurrency.processutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_concurrency.processutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.503s {{(pid=77321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77321) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:13:24 devstack cinder-volume[77321]: INFO cinder.rpc [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 28 16:13:24 devstack cinder-volume[77321]: INFO cinder.rpc [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 28 16:13:24 devstack cinder-volume[77321]: WARNING stevedore.named [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 16:13:24 devstack cinder-volume[77321]: WARNING castellan.key_manager [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 16:13:24 devstack cinder-volume[77321]: INFO cinder.volume.manager [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77321) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:13:24 devstack cinder-volume[77321]: INFO oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Starting 1 workers Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Started child 77457 {{(pid=77321) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Full set of CONF: {{(pid=77321) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] ******************************************************************************** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Configuration options gathered from: {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] ================================================================================ {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] allow_availability_zone_fallback = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77457]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] allow_compression_on_image_upload = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] allowed_direct_url_schemes = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] api_rate_limit = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] auth_strategy = keystone {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] az_cache_duration = 3600 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_availability_zone = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_host = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_stats_polling_interval = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backup_api_class = cinder.backup.api.API {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backup_name_template = backup-%s {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backup_use_same_host = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backup_use_temp_snapshot = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] chap_password = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] chap_username = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_internal_tenant_project_id = 0f047fd4a637427aab4ab1fc36ed7ee7 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_internal_tenant_user_id = 110027beac05433ca4e87ddd6ef70399 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cloned_volume_same_az = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cluster = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] compression_format = gzip {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] compute_api_class = cinder.compute.nova.API {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] config_dir = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] config_source = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] control_exchange = openstack {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] debug = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] default_availability_zone = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] default_group_type = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] default_volume_type = lvmdriver-1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] disk_geometry = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] driver_client_cert = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] driver_client_cert_key = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] driver_data_namespace = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] driver_ssl_cert_path = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] driver_ssl_cert_verify = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] driver_use_ssl = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] enable_force_upload = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] enable_new_services = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] enable_unsupported_driver = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] enforce_multipath_for_image_xfer = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] filter_function = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_api_insecure = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_api_ssl_compression = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_ca_certificates_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77457]: INFO cinder.volume.manager [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_catalog_info = image:glance:publicURL {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_num_retries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance_request_timeout = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] goodness_function = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] graceful_shutdown_timeout = 5 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] group_api_class = cinder.group.api.API {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] host = devstack {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_compress_on_upload = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_conversion_address_space_limit = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_conversion_cpu_limit = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_conversion_disable = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_upload_use_cinder_backend = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_upload_use_internal_tenant = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_volume_cache_enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_volume_cache_max_count = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] image_volume_cache_max_size_gb = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] init_host_max_objects_retrieval = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] instance_format = [instance: %(uuid)s] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] iscsi_target_flags = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] iscsi_write_cache = on {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] iser_helper = tgtadm {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] iser_ip_address = 192.168.122.209 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] iser_port = 3260 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_color = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_config_append = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_dir = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_options = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_rotate_interval = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_rotate_interval_type = days {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] log_rotation_type = none {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] max_age = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] max_logfile_count = 30 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] max_logfile_size_mb = 200 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] max_over_subscription_ratio = 20.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] message_reap_interval = 86400 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] message_ttl = 2592000 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] migration_create_volume_timeout_secs = 300 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] monkey_patch = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] monkey_patch_modules = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] my_ip = 192.168.122.209 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] no_snapshot_gb_quota = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] num_iser_scan_tries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] num_shell_tries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] num_volume_device_scan_tries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] nvmeof_conn_info_version = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] nvmet_ns_id = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] nvmet_port_id = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] osapi_max_limit = 1000 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] osapi_volume_ext_list = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] osapi_volume_listen_port = 8776 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] osapi_volume_use_ssl = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] osapi_volume_workers = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] per_volume_size_limit = -1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] periodic_fuzzy_delay = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] periodic_interval = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] public_endpoint = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] publish_errors = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] quota_backup_gigabytes = 1000 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] quota_backups = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] quota_gigabytes = 1000 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] quota_groups = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] quota_snapshots = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] quota_volumes = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] rate_limit_burst = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] rate_limit_except_level = CRITICAL {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] rate_limit_interval = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] reinit_driver_count = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] replication_device = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] report_discard_supported = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] report_interval = 120 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] reservation_clean_interval = 86400 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] reservation_expire = 86400 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] reserved_image_namespaces = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] reserved_percentage = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] rpc_response_timeout = 120 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] run_external_periodic_tasks = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] scst_target_driver = iscsi {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] scst_target_iqn_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_down_time = 720 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] shell_completion = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] snapshot_name_template = snapshot-%s {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] snapshot_same_host = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] split_loggers = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] state_path = /opt/stack/data/cinder {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] storage_availability_zone = nova {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] storage_protocol = iSCSI {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] syslog_log_facility = LOG_USER {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] target_helper = lioadm {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] target_ip_address = 192.168.122.209 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] target_port = 3260 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] target_protocol = iscsi {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] target_secondary_ip_addresses = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] trace_flags = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] transport_url = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] until_refresh = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] use_chap_auth = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] use_default_quota_class = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] use_journal = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] use_json = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] use_multipath_for_image_xfer = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] use_stderr = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] use_syslog = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] verify_glance_signatures = enabled {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_api_class = cinder.volume.api.API {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_backend_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_clear = zero {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_clear_ionice = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_clear_size = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_copy_bps_limit = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_dd_blocksize = 1M {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_name_template = volume-%s {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_service_inithost_offload = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volume_usage_audit_period = month {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] zoning_mode = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_concurrency.disable_process_locking = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack sudo[77462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 28 16:13:24 devstack sudo[77462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.auth_section = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.auth_type = password {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.auth_version = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.cache = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.include_service_catalog = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.insecure = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.interface = public {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_password = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcache_username = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.region_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.service_type = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.backend = dogpile.cache.null {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.backend_argument = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.backend_expiration_time = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.config_prefix = cache.oslo {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.debug_cache_backend = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.enable_retry_client = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.enable_socket_keepalive = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.expiration_time = 600 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.hashclient_retry_attempts = 2 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.memcache_dead_retry = 300 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.memcache_pool_maxsize = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.memcache_sasl_enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.password = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.proxies = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.redis_db = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.redis_server = localhost:6379 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.retry_attempts = 2 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.retry_delay = 0.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.socket_keepalive_count = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.socket_keepalive_idle = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.socket_keepalive_interval = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.socket_timeout = 1.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.tls_allowed_ciphers = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.tls_cafile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.tls_certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.tls_enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.tls_keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cache.username = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] coordination.backend_url = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.asyncio_connection = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.asyncio_slave_connection = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.backend = sqlalchemy {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.connection = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.connection_debug = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.connection_parameters = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.connection_recycle_time = 3600 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.connection_trace = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.db_inc_retry_interval = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.db_max_retries = 20 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.db_max_retry_interval = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.db_retry_interval = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.max_overflow = 50 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.max_pool_size = 5 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.max_retries = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.mysql_wsrep_sync_wait = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.pool_timeout = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.retry_interval = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.slave_connection = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.sqlite_synchronous = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.synchronous_reader = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] database.use_db_reconnect = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.connection_string = messaging:// {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.es_doc_type = notification {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.es_scroll_size = 10000 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.es_scroll_time = 2m {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.filter_error_trace = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.hmac_keys = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.sentinel_service_name = mymaster {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.socket_timeout = 0.1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.trace_requests = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler.trace_sqlalchemy = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler_jaeger.process_tags = {} {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler_jaeger.service_name_prefix = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] profiler_otlp.service_name_prefix = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.enforce_new_defaults = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.policy_default_rule = default {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.policy_file = policy.yaml {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] privsep_osbrick.group = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] privsep_osbrick.helper_command = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] privsep_osbrick.user = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_sys_admin.group = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_sys_admin.helper_command = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] cinder_sys_admin.user = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.auth_section = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.auth_type = password {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.cafile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.collect_timing = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.insecure = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.send_service_user_token = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.split_loggers = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] service_user.timeout = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.auth_section = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.auth_type = password {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.collect_timing = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.insecure = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.region_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.split_loggers = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] glance.timeout = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.backend_availability_zone = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.chap_password = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.chap_username = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.disk_geometry = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.driver_client_cert = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.driver_client_cert_key = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.driver_data_namespace = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.driver_use_ssl = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.extra_capabilities = {} {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.filter_function = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.goodness_function = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.iscsi_target_flags = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.iscsi_write_cache = on {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.iser_helper = tgtadm {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.iser_port = 3260 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.lvm_share_target = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.lvm_type = auto {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.num_shell_tries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.replication_device = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.report_discard_supported = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.reserved_percentage = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.target_helper = tgtadm {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.target_port = 3260 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.target_protocol = iscsi {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.trace_flags = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.unique_fqdn_network = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.use_chap_auth = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_backend_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_clear = zero {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_clear_ionice = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_clear_size = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_reports.file_event_handler = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_reports.log_dir = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.backend_host = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.chap_password = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.chap_username = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.disk_geometry = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.driver_client_cert = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.extra_capabilities = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.filter_function = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.goodness_function = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.iser_helper = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.iser_ip_address = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.iser_port = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.lvm_share_target = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.lvm_type = auto {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.num_shell_tries = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.replication_device = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.report_discard_supported = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.reserved_percentage = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.scst_target_driver = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.storage_protocol = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.target_helper = lioadm {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.target_ip_address = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.target_port = 3260 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.trace_flags = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.use_chap_auth = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_clear = zero {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_clear_size = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] lvmdriver-1.volumes_dir = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.ssl = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_notifications.driver = [] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_notifications.retry = -1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] key_manager.fixed_key = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.barbican_api_version = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.barbican_endpoint = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.barbican_endpoint_type = public {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.barbican_region_name = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.cafile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.collect_timing = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.insecure = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.number_of_retries = 60 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.retry_delay = 1 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.send_service_user_token = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.split_loggers = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.timeout = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.verify_ssl = True {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican.verify_ssl_path = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.auth_section = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.auth_type = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.cafile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.certfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.collect_timing = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.insecure = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.keyfile = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.split_loggers = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] barbican_service_user.timeout = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.approle_role_id = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.approle_secret_id = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.auth_method = approle {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.auth_path = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.kv_mountpoint = secret {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.kv_path = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.kv_version = 2 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.namespace = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.root_token_id = **** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.ssl_ca_crt_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.timeout = 60.0 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.token_file = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.token_role = None {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.use_ssl = False {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:13:24 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] ******************************************************************************** {{(pid=77321) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 16:13:24 devstack sudo[77462]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack sudo[77515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:24 devstack sudo[77515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:24 devstack sudo[77515]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:13:24 devstack cinder-volume[77457]: INFO cinder.brick.local_dev.lvm [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:24 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:24 devstack sudo[77632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:13:24 devstack sudo[77632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:25 devstack sudo[77632]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG cinder.brick.local_dev.lvm [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77457) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:25 devstack sudo[77714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:25 devstack sudo[77714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:25 devstack sudo[77714]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:25 devstack sudo[77887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:25 devstack sudo[77887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:25 devstack sudo[77887]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:25 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:26 devstack sudo[77979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 28 16:13:26 devstack sudo[77979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:26 devstack sudo[77979]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.355s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:26 devstack sudo[78069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:13:26 devstack sudo[78069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:26 devstack sudo[78069]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:26 devstack sudo[78072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:13:26 devstack sudo[78072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:26 devstack sudo[78072]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:26 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:26 devstack sudo[78155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:13:26 devstack sudo[78155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:27 devstack sudo[78155]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:27 devstack sudo[78158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:27 devstack sudo[78158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:27 devstack sudo[78158]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:27 devstack sudo[78204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:27 devstack sudo[78204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:27 devstack sudo[78204]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:27 devstack cinder-volume[77457]: INFO cinder.volume.drivers.lvm [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:27 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:27 devstack sudo[78253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:27 devstack sudo[78253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:28 devstack sudo[78253]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG cinder.volume.drivers.lvm [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Updating volume stats {{(pid=77457) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:28 devstack sudo[78262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:13:28 devstack sudo[78262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:28 devstack sudo[78262]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:28 devstack sudo[78265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:13:28 devstack sudo[78265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:28 devstack sudo[78265]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:28 devstack sudo[78268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:28 devstack sudo[78268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:28 devstack sudo[78268]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:28 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:28 devstack sudo[78271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:13:28 devstack sudo[78271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:29 devstack sudo[78271]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:29 devstack cinder-volume[77457]: INFO cinder.volume.driver [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Driver hasn't implemented _init_vendor_properties() Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG cinder.volume.driver [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77457) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG oslo_db.sqlalchemy.engines [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77457) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG dbcounter [-] [77457] Writer thread running {{(pid=77457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG cinder.db.api [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Building query based on filter {{(pid=77457) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG cinder.image.image_utils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77457) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 16:13:29 devstack cinder-volume[77457]: INFO cinder.keymgr.migration [None req-10a5e86d-a0ce-4a02-87ee-f90f49470aa2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG cinder.volume.drivers.lvm [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Updating volume stats {{(pid=77457) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:29 devstack sudo[78275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:13:29 devstack sudo[78275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:29 devstack sudo[78275]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:29 devstack sudo[78278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:13:29 devstack sudo[78278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:29 devstack sudo[78278]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:29 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:29 devstack sudo[78283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:29 devstack sudo[78283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:30 devstack sudo[78283]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:30 devstack sudo[78286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:13:30 devstack sudo[78286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:30 devstack sudo[78286]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG cinder.manager [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Notifying Schedulers of capabilities ... {{(pid=77457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:13:30 devstack cinder-volume[77457]: INFO cinder.volume.manager [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Driver initialization completed successfully. Jul 28 16:13:30 devstack cinder-volume[77457]: INFO cinder.manager [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Initiating service 2 cleanup Jul 28 16:13:30 devstack cinder-volume[77457]: INFO cinder.manager [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Service 2 cleanup completed. Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG cinder.service [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Creating RPC server for service cinder-volume {{(pid=77457) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG cinder.service [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77457) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 16:13:30 devstack cinder-volume[77457]: INFO cinder.volume.manager [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG cinder.volume.drivers.lvm [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Updating volume stats {{(pid=77457) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:30 devstack sudo[78291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:13:30 devstack sudo[78291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:30 devstack sudo[78291]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:30 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:30 devstack sudo[78294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:13:30 devstack sudo[78294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:31 devstack sudo[78294]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:31 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:31 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:31 devstack sudo[78297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:13:31 devstack sudo[78297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:31 devstack sudo[78297]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:31 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:31 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:13:31 devstack sudo[78303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:13:31 devstack sudo[78303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:13:31 devstack sudo[78303]: pam_unix(sudo:session): session closed for user root Jul 28 16:13:31 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:13:31 devstack cinder-volume[77457]: INFO cinder.volume.manager [None req-399c14b3-78df-4b75-85de-d55e4c82788c None None] Driver post RPC initialization completed successfully. Jul 28 16:13:34 devstack cinder-volume[77321]: DEBUG dbcounter [-] [77321] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77321) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:13:41 devstack cinder-volume[77457]: DEBUG dbcounter [-] [77457] Writing DB stats cinder:SELECT=4 {{(pid=77457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:13:41 devstack cinder-volume[77457]: DEBUG dbcounter [-] [77457] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:14:03 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager._thread_info {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:14:03 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread count: 6 {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:14:03 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread info: [<_MainThread(MainThread, started 126873986859136)>, , , , , ] {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:15:03 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:15:03 devstack cinder-volume[77457]: DEBUG cinder.volume.drivers.lvm [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Updating volume stats {{(pid=77457) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 16:15:03 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:15:03 devstack sudo[80984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:15:03 devstack sudo[80984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:15:04 devstack sudo[80984]: pam_unix(sudo:session): session closed for user root Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:15:04 devstack sudo[80987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:15:04 devstack sudo[80987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:15:04 devstack sudo[80987]: pam_unix(sudo:session): session closed for user root Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:15:04 devstack sudo[80990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:15:04 devstack sudo[80990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:15:04 devstack sudo[80990]: pam_unix(sudo:session): session closed for user root Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:15:04 devstack sudo[80993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:15:04 devstack sudo[80993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:15:04 devstack sudo[80993]: pam_unix(sudo:session): session closed for user root Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG cinder.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Notifying Schedulers of capabilities ... {{(pid=77457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager._thread_info {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread count: 6 {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:15:04 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread info: [<_MainThread(MainThread, started 126873986859136)>, , , , , ] {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:15:41 devstack cinder-volume[77457]: DEBUG dbcounter [-] [77457] Writing DB stats cinder:SELECT=1 {{(pid=77457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:15:41 devstack cinder-volume[77457]: DEBUG dbcounter [-] [77457] Writing DB stats cinder:UPDATE=1 {{(pid=77457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:16:03 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:16:03 devstack cinder-volume[77457]: DEBUG cinder.volume.drivers.lvm [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Updating volume stats {{(pid=77457) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 16:16:03 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:16:03 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:16:03 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:16:04 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:16:04 devstack sudo[84693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:16:04 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:16:04 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:16:04 devstack sudo[84704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:16:04 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:16:04 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:16:04 devstack sudo[84709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:16:04 devstack sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:16:04 devstack sudo[84709]: pam_unix(sudo:session): session closed for user root Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG cinder.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Notifying Schedulers of capabilities ... {{(pid=77457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager._thread_info {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread count: 6 {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:16:04 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread info: [<_MainThread(MainThread, started 126873986859136)>, , , , , ] {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:17:03 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:17:03 devstack cinder-volume[77457]: DEBUG cinder.volume.drivers.lvm [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Updating volume stats {{(pid=77457) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 16:17:03 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:17:03 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:17:03 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:17:04 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:17:04 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:17:04 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:17:04 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:17:04 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:17:04 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:17:04 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:17:04 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:17:04 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:17:04 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:17:04 devstack cinder-volume[77457]: DEBUG cinder.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Notifying Schedulers of capabilities ... {{(pid=77457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:17:41 devstack cinder-volume[77457]: DEBUG dbcounter [-] [77457] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:18:03 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:18:03 devstack cinder-volume[77457]: DEBUG cinder.volume.drivers.lvm [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Updating volume stats {{(pid=77457) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 16:18:03 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:03 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 16:18:03 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:04 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:04 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:18:04 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:04 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:04 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 16:18:04 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:04 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:04 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 16:18:04 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:04 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_concurrency.processutils [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG cinder.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Notifying Schedulers of capabilities ... {{(pid=77457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG oslo_service.periodic_task [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] Running periodic task VolumeManager._thread_info {{(pid=77457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread count: 6 {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:18:04 devstack cinder-volume[77457]: DEBUG cinder.volume.manager [None req-606ed5b4-29ff-4591-8f4a-5f0a8ad6155e None None] thread info: [<_MainThread(MainThread, started 126873986859136)>, , , , , ] {{(pid=77457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:18:06 devstack cinder-volume[77321]: INFO oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Caught SIGTERM, stopping children Jul 28 16:18:06 devstack cinder-volume[77321]: DEBUG oslo_concurrency.lockutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Acquiring lock "singleton_lock" {{(pid=77321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 16:18:06 devstack cinder-volume[77321]: DEBUG oslo_concurrency.lockutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Acquired lock "singleton_lock" {{(pid=77321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 16:18:06 devstack cinder-volume[77321]: DEBUG oslo_concurrency.lockutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Releasing lock "singleton_lock" {{(pid=77321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 16:18:06 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Stop services. {{(pid=77321) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 28 16:18:06 devstack cinder-volume[77321]: DEBUG oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Killing children. {{(pid=77321) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 28 16:18:06 devstack cinder-volume[77321]: INFO oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Waiting on 1 children to exit Jul 28 16:18:10 devstack cinder-volume[77457]: DEBUG oslo_concurrency.lockutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Acquiring lock "singleton_lock" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 16:18:10 devstack cinder-volume[77457]: DEBUG oslo_concurrency.lockutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Acquired lock "singleton_lock" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 16:18:10 devstack cinder-volume[77457]: DEBUG oslo_concurrency.lockutils [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Releasing lock "singleton_lock" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 16:18:10 devstack cinder-volume[77457]: WARNING amqp [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 16:18:10 devstack cinder-volume[77457]: WARNING amqp [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 16:18:10 devstack cinder-volume[77321]: INFO oslo_service.backend._eventlet.service [None req-d8c4626f-f99e-4c4c-964b-7b6172ecc5e4 None None] Child 77457 exited with status 0 Jul 28 16:18:11 devstack cinder-volume[87599]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 16:18:11 devstack cinder-volume[87599]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 16:18:11 devstack cinder-volume[87599]: we strongly recommend against using it for new projects. Jul 28 16:18:11 devstack cinder-volume[87599]: If you are already using Eventlet, we recommend migrating to a different Jul 28 16:18:11 devstack cinder-volume[87599]: framework. For more detail see Jul 28 16:18:11 devstack cinder-volume[87599]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 16:18:11 devstack cinder-volume[87599]: import eventlet # noqa Jul 28 16:18:13 devstack cinder-volume[87599]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 16:18:13 devstack cinder-volume[87599]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 16:18:13 devstack cinder-volume[87599]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 16:18:13 devstack cinder-volume[87599]: INFO dbcounter [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Registered counter for database cinder Jul 28 16:18:13 devstack cinder-volume[87599]: DEBUG oslo_db.sqlalchemy.engines [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG dbcounter [-] [87599] Writer thread running {{(pid=87599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 16:18:14 devstack cinder-volume[87599]: INFO cinder.rpc [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 16:18:14 devstack cinder-volume[87599]: INFO cinder.rpc [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_db.sqlalchemy.engines [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:14 devstack cinder-volume[87599]: INFO cinder.volume.manager [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Determined volume DB was empty at startup. Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG cinder.volume.manager [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87599) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 16:18:14 devstack cinder-volume[87599]: INFO cinder.volume.manager [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 28 16:18:14 devstack cinder-volume[87599]: WARNING stevedore.named [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 16:18:14 devstack cinder-volume[87599]: WARNING castellan.key_manager [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 16:18:14 devstack cinder-volume[87599]: WARNING cinder.keymgr.conf_key_mgr [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 16:18:14 devstack cinder-volume[87599]: INFO cinder.volume.manager [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_db.sqlalchemy.engines [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:14 devstack cinder-volume[87599]: INFO oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Starting 1 workers Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Started child 87870 {{(pid=87599) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Full set of CONF: {{(pid=87599) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] ******************************************************************************** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Configuration options gathered from: {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] ================================================================================ {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] allow_availability_zone_fallback = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] allow_compression_on_image_upload = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] allowed_direct_url_schemes = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] api_rate_limit = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] auth_strategy = keystone {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_availability_zone = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_host = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_stats_polling_interval = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backup_api_class = cinder.backup.api.API {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87870]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backup_name_template = backup-%s {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backup_use_same_host = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backup_use_temp_snapshot = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] chap_password = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] chap_username = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_internal_tenant_project_id = 0f047fd4a637427aab4ab1fc36ed7ee7 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_internal_tenant_user_id = 110027beac05433ca4e87ddd6ef70399 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cluster = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] compression_format = gzip {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] compute_api_class = cinder.compute.nova.API {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] config_dir = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] config_source = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] control_exchange = openstack {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] debug = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] default_availability_zone = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] default_group_type = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] default_volume_type = QuobyteHD {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] disk_geometry = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] driver_client_cert = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] driver_client_cert_key = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] driver_data_namespace = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] driver_ssl_cert_path = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] driver_ssl_cert_verify = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] driver_use_ssl = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] enable_new_services = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] enable_unsupported_driver = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] enabled_backends = ['QuobyteHD'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] enforce_multipath_for_image_xfer = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] filter_function = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_api_insecure = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_api_ssl_compression = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_ca_certificates_file = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_catalog_info = image:glance:publicURL {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_num_retries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance_request_timeout = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] goodness_function = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] graceful_shutdown_timeout = 5 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] group_api_class = cinder.group.api.API {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] host = devstack {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_compress_on_upload = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_conversion_address_space_limit = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_conversion_cpu_limit = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_conversion_disable = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_upload_use_cinder_backend = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_upload_use_internal_tenant = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_volume_cache_enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_volume_cache_max_count = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] image_volume_cache_max_size_gb = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] init_host_max_objects_retrieval = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] instance_format = [instance: %(uuid)s] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] iscsi_target_flags = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] iscsi_write_cache = on {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] iser_helper = tgtadm {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] iser_ip_address = 192.168.122.209 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] iser_port = 3260 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_color = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_config_append = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_dir = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_file = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_options = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_rotate_interval = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_rotate_interval_type = days {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] log_rotation_type = none {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] max_age = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] max_logfile_count = 30 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] max_logfile_size_mb = 200 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] max_over_subscription_ratio = 20.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] message_reap_interval = 86400 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] message_ttl = 2592000 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] migration_create_volume_timeout_secs = 300 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] monkey_patch = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] monkey_patch_modules = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] my_ip = 192.168.122.209 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] no_snapshot_gb_quota = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] num_iser_scan_tries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] num_shell_tries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] num_volume_device_scan_tries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] nvmeof_conn_info_version = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] nvmet_ns_id = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] nvmet_port_id = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] osapi_max_limit = 1000 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] osapi_volume_ext_list = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] osapi_volume_listen_port = 8776 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] osapi_volume_use_ssl = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] osapi_volume_workers = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] per_volume_size_limit = -1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] periodic_fuzzy_delay = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] periodic_interval = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] public_endpoint = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] publish_errors = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] quota_backup_gigabytes = 1000 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] quota_backups = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] quota_gigabytes = 1000 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] quota_groups = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] quota_snapshots = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] quota_volumes = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] rate_limit_burst = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] rate_limit_except_level = CRITICAL {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] rate_limit_interval = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] reinit_driver_count = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] replication_device = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] report_discard_supported = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] report_interval = 120 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] reservation_clean_interval = 86400 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] reservation_expire = 86400 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] reserved_image_namespaces = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] reserved_percentage = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] rpc_response_timeout = 120 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] run_external_periodic_tasks = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] scst_target_driver = iscsi {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] scst_target_iqn_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_down_time = 720 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] shell_completion = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] snapshot_name_template = snapshot-%s {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] split_loggers = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] state_path = /opt/stack/data/cinder {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] storage_availability_zone = nova {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] storage_protocol = iSCSI {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] syslog_log_facility = LOG_USER {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] target_helper = lioadm {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] target_ip_address = 192.168.122.209 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] target_port = 3260 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] target_protocol = iscsi {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] target_secondary_ip_addresses = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] trace_flags = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] transport_url = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] until_refresh = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] use_chap_auth = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] use_default_quota_class = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] use_journal = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] use_json = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] use_multipath_for_image_xfer = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] use_stderr = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] use_syslog = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] verify_glance_signatures = enabled {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_api_class = cinder.volume.api.API {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_backend_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_clear = zero {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_clear_ionice = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_clear_size = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_copy_bps_limit = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_dd_blocksize = 1M {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_name_template = volume-%s {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_service_inithost_offload = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volume_usage_audit_period = month {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87870]: INFO cinder.volume.manager [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Starting volume driver QuobyteDriver (1.2) Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] zoning_mode = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:14 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.remotefs [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87870) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_concurrency.disable_process_locking = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.auth_section = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.auth_type = password {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.auth_version = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.cache = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.include_service_catalog = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.insecure = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.interface = public {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_password = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcache_username = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.region_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.service_type = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.backend = dogpile.cache.null {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.backend_argument = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.backend_expiration_time = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.config_prefix = cache.oslo {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.debug_cache_backend = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.enable_retry_client = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.enable_socket_keepalive = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.expiration_time = 600 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.hashclient_retry_attempts = 2 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.memcache_dead_retry = 300 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.memcache_pool_maxsize = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.memcache_sasl_enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.password = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.proxies = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.redis_db = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.redis_server = localhost:6379 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.retry_attempts = 2 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.retry_delay = 0.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.socket_keepalive_count = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.socket_keepalive_idle = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.socket_keepalive_interval = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.socket_timeout = 1.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.tls_allowed_ciphers = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.tls_cafile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.tls_certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.tls_enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.tls_keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cache.username = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] coordination.backend_url = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.asyncio_connection = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.asyncio_slave_connection = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.backend = sqlalchemy {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.connection = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.connection_debug = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.connection_parameters = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.connection_recycle_time = 3600 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.connection_trace = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.db_inc_retry_interval = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.db_max_retries = 20 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.db_max_retry_interval = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.db_retry_interval = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.max_overflow = 50 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.max_pool_size = 5 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.max_retries = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.mysql_wsrep_sync_wait = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.pool_timeout = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.retry_interval = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.slave_connection = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.sqlite_synchronous = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.synchronous_reader = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] database.use_db_reconnect = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.connection_string = messaging:// {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.es_doc_type = notification {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.es_scroll_size = 10000 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.es_scroll_time = 2m {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.filter_error_trace = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.hmac_keys = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.sentinel_service_name = mymaster {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.socket_timeout = 0.1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.trace_requests = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler.trace_sqlalchemy = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler_jaeger.process_tags = {} {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler_jaeger.service_name_prefix = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] profiler_otlp.service_name_prefix = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.enforce_new_defaults = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.policy_default_rule = default {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.policy_file = policy.yaml {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] privsep_osbrick.group = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] privsep_osbrick.helper_command = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] privsep_osbrick.user = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_sys_admin.group = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_sys_admin.helper_command = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] cinder_sys_admin.user = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.auth_section = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.auth_type = password {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.cafile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.collect_timing = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.insecure = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.send_service_user_token = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.split_loggers = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] service_user.timeout = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.auth_section = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.auth_type = password {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.collect_timing = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.insecure = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.region_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.split_loggers = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] glance.timeout = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.backend_availability_zone = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.chap_password = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.chap_username = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.disk_geometry = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.driver_client_cert = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.driver_client_cert_key = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.driver_data_namespace = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.driver_use_ssl = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.extra_capabilities = {} {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.filter_function = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.goodness_function = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.iscsi_target_flags = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.iscsi_write_cache = on {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.iser_helper = tgtadm {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.iser_port = 3260 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_host = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_login = admin {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_mount_options = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_password = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_private_key = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_share_path = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.num_shell_tries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.quobyte_volume_url = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.replication_device = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.report_discard_supported = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.reserved_percentage = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.target_helper = tgtadm {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.target_port = 3260 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.target_protocol = iscsi {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.trace_flags = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.unique_fqdn_network = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.use_chap_auth = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_backend_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_clear = zero {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_clear_ionice = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_clear_size = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_reports.file_event_handler = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_reports.log_dir = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.backend_availability_zone = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.backend_host = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.chap_password = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.chap_username = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.chiscsi_conf = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.disk_geometry = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.driver_client_cert = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.driver_data_namespace = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.driver_use_ssl = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.extra_capabilities = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.filter_function = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.goodness_function = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.iser_helper = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.iser_ip_address = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.iser_port = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.iser_target_prefix = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_host = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_login = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_mount_options = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_password = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_private_key = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_share_path = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_ssh_port = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.num_shell_tries = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.nvmet_port_id = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.replication_device = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.report_discard_supported = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.reserved_percentage = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.scst_target_driver = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.storage_protocol = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.target_helper = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.target_ip_address = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.target_port = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.target_prefix = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.target_protocol = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.trace_flags = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.use_chap_auth = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_clear = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_clear_size = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] QuobyteHD.volumes_dir = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.ssl = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_notifications.driver = [] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_notifications.retry = -1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] key_manager.fixed_key = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.barbican_api_version = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.barbican_endpoint = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.barbican_endpoint_type = public {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.barbican_region_name = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.cafile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.collect_timing = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.insecure = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.number_of_retries = 60 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.retry_delay = 1 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.send_service_user_token = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.split_loggers = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.timeout = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.verify_ssl = True {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican.verify_ssl_path = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.auth_section = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.auth_type = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.cafile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.certfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.collect_timing = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.insecure = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.keyfile = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.split_loggers = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] barbican_service_user.timeout = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.approle_role_id = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.approle_secret_id = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.auth_method = approle {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.auth_path = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.kv_mountpoint = secret {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.kv_path = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.kv_version = 2 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.namespace = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.root_token_id = **** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.ssl_ca_crt_file = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.timeout = 60.0 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.token_file = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.token_role = None {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.use_ssl = False {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:14 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] ******************************************************************************** {{(pid=87599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 16:18:14 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87870) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 28 16:18:14 devstack cinder-volume[87870]: WARNING cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 28 16:18:14 devstack cinder-volume[87870]: WARNING cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 28 16:18:14 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Running cmd (subprocess): mount.quobyte {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:15 devstack quobyte-client[87873]: Reading configuration file: /etc/quobyte/client.cfg Jul 28 16:18:15 devstack quobyte-client[87873]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=87870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:18:15 devstack cinder-volume[87870]: INFO cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff ... Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 -c /etc/quobyte/client-cinder.cfg {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:15 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 -c /etc/quobyte/client-cinder.cfg Jul 28 16:18:15 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:15 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.412s {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:15 devstack cinder-volume[87870]: INFO cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff succeeded Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=87870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.432s {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:15 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:18:15 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:15 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.265s {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:15 devstack cinder-volume[87870]: INFO cinder.volume.driver [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Driver hasn't implemented _init_vendor_properties() Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG cinder.volume.driver [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757698059082, 'free_capacity_gb': 1775.757698059082, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87870) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_db.sqlalchemy.engines [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87870) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG dbcounter [-] [87870] Writer thread running {{(pid=87870) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG cinder.db.api [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Building query based on filter {{(pid=87870) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG cinder.image.image_utils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87870) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 16:18:15 devstack cinder-volume[87870]: INFO cinder.keymgr.migration [None req-b70803c6-11fe-41de-be42-2ff0c0a24765 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=87870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=87870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:18:15 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:15 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:18:15 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:16 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.284s {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG cinder.manager [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Notifying Schedulers of capabilities ... {{(pid=87870) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:18:16 devstack cinder-volume[87870]: INFO cinder.volume.manager [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Driver initialization completed successfully. Jul 28 16:18:16 devstack cinder-volume[87870]: INFO cinder.manager [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Initiating service 3 cleanup Jul 28 16:18:16 devstack cinder-volume[87870]: INFO cinder.manager [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Service 3 cleanup completed. Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG cinder.service [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Creating RPC server for service cinder-volume {{(pid=87870) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG cinder.service [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87870) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 16:18:16 devstack cinder-volume[87870]: INFO cinder.volume.manager [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=87870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG cinder.volume.drivers.quobyte [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=87870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:16 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:18:16 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:16 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:16 devstack cinder-volume[87870]: DEBUG oslo_concurrency.processutils [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.310s {{(pid=87870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:16 devstack cinder-volume[87870]: INFO cinder.volume.manager [None req-f030440d-84d7-4951-86c5-d1af95d26160 None None] Driver post RPC initialization completed successfully. Jul 28 16:18:20 devstack cinder-volume[87599]: INFO oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Caught SIGTERM, stopping children Jul 28 16:18:20 devstack cinder-volume[87599]: DEBUG oslo_concurrency.lockutils [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Acquiring lock "singleton_lock" {{(pid=87599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 16:18:20 devstack cinder-volume[87599]: DEBUG oslo_concurrency.lockutils [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Acquired lock "singleton_lock" {{(pid=87599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 16:18:20 devstack cinder-volume[87599]: DEBUG oslo_concurrency.lockutils [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Releasing lock "singleton_lock" {{(pid=87599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 16:18:20 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Stop services. {{(pid=87599) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 28 16:18:20 devstack cinder-volume[87599]: DEBUG oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Killing children. {{(pid=87599) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 28 16:18:20 devstack cinder-volume[87599]: INFO oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Waiting on 1 children to exit Jul 28 16:18:20 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Acquiring lock "singleton_lock" {{(pid=87870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 16:18:20 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Acquired lock "singleton_lock" {{(pid=87870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 16:18:20 devstack cinder-volume[87870]: DEBUG oslo_concurrency.lockutils [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Releasing lock "singleton_lock" {{(pid=87870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 16:18:20 devstack cinder-volume[87870]: WARNING amqp [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 16:18:20 devstack cinder-volume[87870]: WARNING amqp [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 16:18:20 devstack cinder-volume[87599]: INFO oslo_service.backend._eventlet.service [None req-e21627bb-7a1e-4f3b-8874-37376a39c819 None None] Child 87870 exited with status 0 Jul 28 16:18:21 devstack cinder-volume[88225]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 16:18:21 devstack cinder-volume[88225]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 16:18:21 devstack cinder-volume[88225]: we strongly recommend against using it for new projects. Jul 28 16:18:21 devstack cinder-volume[88225]: If you are already using Eventlet, we recommend migrating to a different Jul 28 16:18:21 devstack cinder-volume[88225]: framework. For more detail see Jul 28 16:18:21 devstack cinder-volume[88225]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 16:18:21 devstack cinder-volume[88225]: import eventlet # noqa Jul 28 16:18:23 devstack cinder-volume[88225]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 16:18:23 devstack cinder-volume[88225]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 16:18:23 devstack cinder-volume[88225]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 16:18:23 devstack cinder-volume[88225]: INFO dbcounter [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Registered counter for database cinder Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_db.sqlalchemy.engines [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG dbcounter [-] [88225] Writer thread running {{(pid=88225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 16:18:24 devstack cinder-volume[88225]: INFO cinder.rpc [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 16:18:24 devstack cinder-volume[88225]: INFO cinder.rpc [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_db.sqlalchemy.engines [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:24 devstack cinder-volume[88225]: INFO cinder.volume.manager [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Determined volume DB was empty at startup. Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG cinder.volume.manager [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88225) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 16:18:24 devstack cinder-volume[88225]: WARNING stevedore.named [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 16:18:24 devstack cinder-volume[88225]: WARNING castellan.key_manager [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 16:18:24 devstack cinder-volume[88225]: WARNING cinder.keymgr.conf_key_mgr [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 16:18:24 devstack cinder-volume[88225]: INFO cinder.volume.manager [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_db.sqlalchemy.engines [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:24 devstack cinder-volume[88225]: INFO oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Starting 1 workers Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Started child 88286 {{(pid=88225) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Full set of CONF: {{(pid=88225) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] ******************************************************************************** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] Configuration options gathered from: {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] ================================================================================ {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] allow_availability_zone_fallback = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] allow_compression_on_image_upload = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88286]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] allowed_direct_url_schemes = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] api_rate_limit = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] auth_strategy = keystone {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_availability_zone = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_host = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_stats_polling_interval = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backup_api_class = cinder.backup.api.API {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backup_name_template = backup-%s {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backup_use_same_host = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backup_use_temp_snapshot = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] chap_password = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] chap_username = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_internal_tenant_project_id = 0f047fd4a637427aab4ab1fc36ed7ee7 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_internal_tenant_user_id = 110027beac05433ca4e87ddd6ef70399 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cluster = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] compression_format = gzip {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] compute_api_class = cinder.compute.nova.API {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] config_dir = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] config_source = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] control_exchange = openstack {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] debug = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] default_availability_zone = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] default_group_type = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] default_volume_type = QuobyteHD {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] disk_geometry = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] driver_client_cert = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] driver_client_cert_key = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] driver_data_namespace = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] driver_ssl_cert_path = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] driver_ssl_cert_verify = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] driver_use_ssl = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] enable_new_services = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] enable_unsupported_driver = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] enabled_backends = ['QuobyteHD'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] enforce_multipath_for_image_xfer = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] filter_function = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_api_insecure = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_api_ssl_compression = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_ca_certificates_file = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_catalog_info = image:glance:publicURL {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_num_retries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance_request_timeout = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] goodness_function = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] graceful_shutdown_timeout = 5 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] group_api_class = cinder.group.api.API {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] host = devstack {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_compress_on_upload = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_conversion_address_space_limit = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_conversion_cpu_limit = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_conversion_disable = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_upload_use_cinder_backend = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_upload_use_internal_tenant = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_volume_cache_enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_volume_cache_max_count = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] image_volume_cache_max_size_gb = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] init_host_max_objects_retrieval = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] instance_format = [instance: %(uuid)s] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] iscsi_target_flags = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] iscsi_write_cache = on {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] iser_helper = tgtadm {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] iser_ip_address = 192.168.122.209 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] iser_port = 3260 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_color = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_config_append = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_dir = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_file = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_options = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_rotate_interval = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_rotate_interval_type = days {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] log_rotation_type = none {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] max_age = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] max_logfile_count = 30 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] max_logfile_size_mb = 200 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] max_over_subscription_ratio = 20.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] message_reap_interval = 86400 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] message_ttl = 2592000 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] migration_create_volume_timeout_secs = 300 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] monkey_patch = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] monkey_patch_modules = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] my_ip = 192.168.122.209 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] no_snapshot_gb_quota = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] num_iser_scan_tries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Starting volume driver QuobyteDriver (1.2) Jul 28 16:18:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88286) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] num_shell_tries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] num_volume_device_scan_tries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] nvmeof_conn_info_version = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] nvmet_ns_id = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] nvmet_port_id = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] osapi_max_limit = 1000 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] osapi_volume_ext_list = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] osapi_volume_listen = 0.0.0.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] osapi_volume_listen_port = 8776 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] osapi_volume_use_ssl = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] osapi_volume_workers = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] per_volume_size_limit = -1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] periodic_fuzzy_delay = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] periodic_interval = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] project_id_regex = [0-9a-f\-]+ {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] public_endpoint = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] publish_errors = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] quota_backup_gigabytes = 1000 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] quota_backups = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] quota_gigabytes = 1000 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] quota_groups = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] quota_snapshots = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] quota_volumes = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] rate_limit_burst = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] rate_limit_except_level = CRITICAL {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] rate_limit_interval = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] reinit_driver_count = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] replication_device = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] report_discard_supported = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] report_interval = 120 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] reservation_clean_interval = 86400 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] reservation_expire = 86400 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] reserved_image_namespaces = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] reserved_percentage = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] rpc_response_timeout = 120 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] run_external_periodic_tasks = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] scst_target_driver = iscsi {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] scst_target_iqn_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_down_time = 720 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] shell_completion = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] snapshot_name_template = snapshot-%s {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] split_loggers = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] state_path = /opt/stack/data/cinder {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] storage_availability_zone = nova {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] storage_protocol = iSCSI {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] syslog_log_facility = LOG_USER {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] target_helper = lioadm {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] target_ip_address = 192.168.122.209 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] target_port = 3260 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] target_protocol = iscsi {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] target_secondary_ip_addresses = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] trace_flags = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] transfer_api_class = cinder.transfer.api.API {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] transport_url = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] until_refresh = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] use_chap_auth = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] use_default_quota_class = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] use_journal = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] use_json = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] use_multipath_for_image_xfer = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] use_stderr = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] use_syslog = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] verify_glance_signatures = enabled {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_api_class = cinder.volume.api.API {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_backend_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_clear = zero {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_clear_ionice = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_clear_size = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_copy_bps_limit = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_dd_blocksize = 1M {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_name_template = volume-%s {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_service_inithost_offload = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volume_usage_audit_period = month {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] zoning_mode = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_concurrency.disable_process_locking = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:24 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.auth_section = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.auth_type = password {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.auth_version = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.cache = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.delay_auth_decision = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.http_connect_timeout = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.include_service_catalog = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.insecure = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.interface = public {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_password = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcache_username = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.region_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.service_token_roles_required = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.service_type = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.token_cache_time = 300 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.backend = dogpile.cache.null {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.backend_argument = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.backend_expiration_time = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.config_prefix = cache.oslo {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.debug_cache_backend = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.enable_retry_client = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.enable_socket_keepalive = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.expiration_time = 600 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.hashclient_retry_attempts = 2 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.memcache_dead_retry = 300 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.memcache_pool_maxsize = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.memcache_sasl_enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.password = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.proxies = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.redis_db = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.redis_sentinel_service_name = mymaster {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.redis_server = localhost:6379 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.retry_attempts = 2 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.retry_delay = 0.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.socket_keepalive_count = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.socket_keepalive_idle = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.socket_keepalive_interval = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.socket_timeout = 1.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.tls_allowed_ciphers = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.tls_cafile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.tls_certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.tls_enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.tls_keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cache.username = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] coordination.backend_url = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.asyncio_connection = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.asyncio_slave_connection = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.backend = sqlalchemy {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.connection = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.connection_debug = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.connection_parameters = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.connection_recycle_time = 3600 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.connection_trace = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.db_inc_retry_interval = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.db_max_retries = 20 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.db_max_retry_interval = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.db_retry_interval = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.max_overflow = 50 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.max_pool_size = 5 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.max_retries = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.mysql_wsrep_sync_wait = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.pool_timeout = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.retry_interval = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.slave_connection = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.sqlite_synchronous = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.synchronous_reader = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] database.use_db_reconnect = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.connection_string = messaging:// {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.es_doc_type = notification {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.es_scroll_size = 10000 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.es_scroll_time = 2m {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.filter_error_trace = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.hmac_keys = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.sentinel_service_name = mymaster {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.socket_timeout = 0.1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.trace_requests = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler.trace_sqlalchemy = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler_jaeger.process_tags = {} {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler_jaeger.service_name_prefix = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] profiler_otlp.service_name_prefix = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.enforce_new_defaults = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.policy_default_rule = default {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.policy_file = policy.yaml {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_policy.remote_timeout = 60.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] privsep_osbrick.group = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] privsep_osbrick.helper_command = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] privsep_osbrick.user = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_sys_admin.group = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_sys_admin.helper_command = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] cinder_sys_admin.user = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.auth_section = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.auth_type = password {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.cafile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.collect_timing = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.insecure = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.send_service_user_token = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.split_loggers = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] service_user.timeout = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.auth_section = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.auth_type = password {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.collect_timing = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.insecure = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88286) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 28 16:18:25 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 28 16:18:25 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.region_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.split_loggers = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] glance.timeout = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.backend_availability_zone = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Running cmd (subprocess): mount.quobyte {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.chap_password = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.chap_username = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.disk_geometry = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.driver_client_cert = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.driver_client_cert_key = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.driver_data_namespace = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.driver_use_ssl = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.enable_unsupported_driver = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.extra_capabilities = {} {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.filter_function = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.goodness_function = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.iscsi_target_flags = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.iscsi_write_cache = on {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.iser_helper = tgtadm {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.iser_port = 3260 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_host = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_login = admin {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_mount_options = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_password = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_private_key = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_share_path = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_ssh_port = 22 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.num_shell_tries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.nvmet_port_id = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.quobyte_client_cfg = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.quobyte_volume_url = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.replication_device = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.report_discard_supported = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.reserved_percentage = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.scst_target_driver = iscsi {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.scst_target_iqn_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.storage_protocol = iSCSI {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.target_helper = tgtadm {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.target_port = 3260 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.target_protocol = iscsi {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.trace_flags = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.unique_fqdn_network = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.use_chap_auth = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_backend_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_clear = zero {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_clear_ionice = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_clear_size = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_reports.file_event_handler = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_reports.log_dir = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.backend_availability_zone = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.backend_host = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.chap_password = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.chap_username = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.chiscsi_conf = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.disk_geometry = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.driver_client_cert = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.driver_client_cert_key = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.driver_data_namespace = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.driver_use_ssl = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.extra_capabilities = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.filter_function = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.goodness_function = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.iscsi_target_flags = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.iscsi_write_cache = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.iser_helper = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.iser_ip_address = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.iser_port = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.iser_target_prefix = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_host = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_login = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_mount_options = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_password = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_private_key = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_share_path = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_ssh_port = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.num_shell_tries = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nvmet_ns_id = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.nvmet_port_id = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.replication_device = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.report_discard_supported = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.reserved_percentage = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.scst_target_driver = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.storage_protocol = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.target_helper = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.target_ip_address = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.target_port = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.target_prefix = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.target_protocol = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.trace_flags = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.unique_fqdn_network = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.use_chap_auth = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_clear = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_clear_ionice = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_clear_size = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] QuobyteHD.volumes_dir = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.ssl = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.ssl_version = {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_notifications.driver = [] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_notifications.retry = -1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] oslo_messaging_notifications.transport_url = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] key_manager.fixed_key = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.barbican_api_version = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.barbican_endpoint = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.barbican_endpoint_type = public {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.barbican_region_name = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.cafile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.collect_timing = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.insecure = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.number_of_retries = 60 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.retry_delay = 1 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.send_service_user_token = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.split_loggers = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.timeout = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.verify_ssl = True {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican.verify_ssl_path = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.auth_section = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.auth_type = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.cafile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.certfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.collect_timing = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.insecure = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.keyfile = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.split_loggers = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] barbican_service_user.timeout = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.approle_role_id = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.approle_secret_id = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.auth_method = approle {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.auth_path = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.kv_mountpoint = secret {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.kv_path = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.kv_version = 2 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.namespace = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.root_token_id = **** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.ssl_ca_crt_file = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.timeout = 60.0 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.token_file = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.token_role = None {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.use_ssl = False {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 16:18:25 devstack cinder-volume[88225]: DEBUG oslo_service.backend._eventlet.service [None req-20663d80-ea0b-41c8-8cf3-8b88c74df11b None None] ******************************************************************************** {{(pid=88225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.245s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:25 devstack cinder-volume[88286]: INFO cinder.volume.driver [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Driver hasn't implemented _init_vendor_properties() Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.driver [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757698059082, 'free_capacity_gb': 1775.757698059082, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88286) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_db.sqlalchemy.engines [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writer thread running {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.db.api [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Building query based on filter {{(pid=88286) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88286) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:25 devstack cinder-volume[88286]: INFO cinder.keymgr.migration [None req-d38904ad-102e-4fa9-ba23-0da73086581a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.279s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:18:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Driver initialization completed successfully. Jul 28 16:18:25 devstack cinder-volume[88286]: INFO cinder.manager [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Initiating service 3 cleanup Jul 28 16:18:25 devstack cinder-volume[88286]: INFO cinder.manager [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Service 3 cleanup completed. Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.service [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Creating RPC server for service cinder-volume {{(pid=88286) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.service [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88286) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 16:18:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:18:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:18:25 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:18:25 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:18:26 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Jul 28 16:18:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.276s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:18:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-08ec3791-823e-40af-89a3-fcfefbbdad7a None None] Driver post RPC initialization completed successfully. Jul 28 16:18:34 devstack cinder-volume[88225]: DEBUG dbcounter [-] [88225] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:18:35 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:18:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:18:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:18:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 6 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:18:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:19:41 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:19:41 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:19:41 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.257s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 6 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:19:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:20:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:20:41 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:20:41 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:20:41 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.340s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:20:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:21:26 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Flow 'volume_create_manager' (044e9228-2dd9-4604-8665-4964745d480a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaafa2b-96b6-471b-8e8b-97012114d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaafa2b-96b6-471b-8e8b-97012114d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-385820338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9c700d-74e2-4d85-99de-4d81c0a590d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8220c3f5f843a7a59111bdda2e34b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:21:27Z,use_quota=True,user_id='b4f4bad8bed44048924da16ace524398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c62473e-304a-4933-a071-2515320c6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c62473e-304a-4933-a071-2515320c6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d9f5c8-1ba9-4283-9cea-07606feb5dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d9f5c8-1ba9-4283-9cea-07606feb5dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9c700d-74e2-4d85-99de-4d81c0a590d3', 'volume_name': 'volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaf9e91-04ac-47ea-9925-d21f32e2cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaf9e91-04ac-47ea-9925-d21f32e2cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25355aa8-944e-404e-89e5-8aba4b657342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:27 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Volume 0e9c700d-74e2-4d85-99de-4d81c0a590d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3', 'volume_size': 1} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-385820338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9c700d-74e2-4d85-99de-4d81c0a590d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8220c3f5f843a7a59111bdda2e34b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:21:27Z,use_quota=True,user_id='b4f4bad8bed44048924da16ace524398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Creating volume 0e9c700d-74e2-4d85-99de-4d81c0a590d3 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:21:27 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:21:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:27 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 1073741824 Jul 28 16:21:27 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:29 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 1073741824" returned: 0 in 1.894s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:29 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 Jul 28 16:21:29 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:30 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3" returned: 0 in 0.908s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] <== create_volume: return (3001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:21:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25355aa8-944e-404e-89e5-8aba4b657342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d96d40-e622-4135-8c29-1911dac2cc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:30 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Volume volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 (0e9c700d-74e2-4d85-99de-4d81c0a590d3): created successfully Jul 28 16:21:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d96d40-e622-4135-8c29-1911dac2cc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Flow 'volume_create_manager' (044e9228-2dd9-4604-8665-4964745d480a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:21:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c0868a38-5fa0-45dc-a082-e61c9bdd2c15 tempest-DeleteServersTestJSON-524519865 None] Created volume successfully. Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Flow 'volume_create_manager' (2832afdf-e8a1-4886-94de-a9274b636e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d02ccb-b4df-4603-bbc5-be1a6f9f7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d02ccb-b4df-4603-bbc5-be1a6f9f7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-911169884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f56a51-cc63-4cde-8853-aa21cd49ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad94c40666ef497a81d69dd14c88edb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:21:32Z,use_quota=True,user_id='2f7387cf842645a39f304e78cf169865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0504729b-9044-44cf-82df-d30929d33935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0504729b-9044-44cf-82df-d30929d33935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee989598-ffed-45fe-97fd-4497db6cb3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee989598-ffed-45fe-97fd-4497db6cb3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f56a51-cc63-4cde-8853-aa21cd49ce46', 'volume_name': 'volume-14f56a51-cc63-4cde-8853-aa21cd49ce46', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f35c293-93f3-4c07-826d-0bfd76469afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f35c293-93f3-4c07-826d-0bfd76469afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8812c874-2045-41ac-93c0-29aa6064a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:32 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Volume 14f56a51-cc63-4cde-8853-aa21cd49ce46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f56a51-cc63-4cde-8853-aa21cd49ce46', 'volume_size': 1} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-911169884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f56a51-cc63-4cde-8853-aa21cd49ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad94c40666ef497a81d69dd14c88edb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:21:32Z,use_quota=True,user_id='2f7387cf842645a39f304e78cf169865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Creating volume 14f56a51-cc63-4cde-8853-aa21cd49ce46 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:21:32 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:21:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:32 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 1073741824 Jul 28 16:21:32 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:33 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 1073741824" returned: 0 in 0.946s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:33 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 Jul 28 16:21:33 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:33 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46" returned: 0 in 0.576s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:21:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8812c874-2045-41ac-93c0-29aa6064a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f56a51-cc63-4cde-8853-aa21cd49ce46', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1c0f9f-e0d6-494e-8c48-2bd8e7e1a9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:34 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Volume volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 (14f56a51-cc63-4cde-8853-aa21cd49ce46): created successfully Jul 28 16:21:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1c0f9f-e0d6-494e-8c48-2bd8e7e1a9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Flow 'volume_create_manager' (2832afdf-e8a1-4886-94de-a9274b636e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:21:34 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b0e251a8-3291-427e-9251-8825157e88d9 tempest-VolumesAdminNegativeTest-1296625335 None] Created volume successfully. Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Acquiring lock "cinder-14f56a51-cc63-4cde-8853-aa21cd49ce46-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Lock "cinder-14f56a51-cc63-4cde-8853-aa21cd49ce46-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Acquiring lock "cinder-quobyte-14f56a51-cc63-4cde-8853-aa21cd49ce46" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Lock "cinder-quobyte-14f56a51-cc63-4cde-8853-aa21cd49ce46" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:21:36 devstack cinder-volume[88286]: INFO oslo.privsep.daemon [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjixj9n5d/privsep.sock'] Jul 28 16:21:36 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjixj9n5d/privsep.sock Jul 28 16:21:36 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:36 devstack cinder-volume[88286]: WARNING py.warnings [req-092e4e68-cfca-4462-b775-1a4069f1f5db req-5f498570-71f5-4898-a1cd-33beec4a2f70 tempest-DeleteServersTestJSON-524519865 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 28 16:21:36 devstack cinder-volume[88286]: .first() Jul 28 16:21:36 devstack cinder-volume[88286]: Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-092e4e68-cfca-4462-b775-1a4069f1f5db req-5f498570-71f5-4898-a1cd-33beec4a2f70 tempest-DeleteServersTestJSON-524519865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-092e4e68-cfca-4462-b775-1a4069f1f5db req-5f498570-71f5-4898-a1cd-33beec4a2f70 tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-092e4e68-cfca-4462-b775-1a4069f1f5db req-5f498570-71f5-4898-a1cd-33beec4a2f70 tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-092e4e68-cfca-4462-b775-1a4069f1f5db req-5f498570-71f5-4898-a1cd-33beec4a2f70 tempest-DeleteServersTestJSON-524519865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27d8ee3b-f02b-4fc8-b163-66f1f43adf13', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:21:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-092e4e68-cfca-4462-b775-1a4069f1f5db req-5f498570-71f5-4898-a1cd-33beec4a2f70 tempest-DeleteServersTestJSON-524519865 None] attachment_update completed successfully. Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: Jul 28 16:21:37 devstack cinder-volume[88286]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 28 16:21:38 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:38 devstack cinder-volume[88286]: INFO oslo.privsep.daemon [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Spawned new privsep daemon via rootwrap Jul 28 16:21:38 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Accepted privsep connection to /tmp/tmpjixj9n5d/privsep.sock {{(pid=88286) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 28 16:21:38 devstack cinder-volume[88286]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 28 16:21:38 devstack cinder-volume[88286]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 28 16:21:38 devstack cinder-volume[88286]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 28 16:21:38 devstack cinder-volume[88286]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89809 Jul 28 16:21:38 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d55a9-04cb-4fc3-80d0-49c641ac178a]: (2,) {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:21:38 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e306bf8-a93b-482d-87b8-36ebaef51ea2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:21:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:38 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 Jul 28 16:21:38 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:39 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46" returned: 0 in 0.899s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:39 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46 Jul 28 16:21:39 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:39 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-14f56a51-cc63-4cde-8853-aa21cd49ce46" returned: 0 in 0.511s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Lock "cinder-quobyte-14f56a51-cc63-4cde-8853-aa21cd49ce46" released by "delete_volume" :: held 3.425s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:21:39 devstack cinder-volume[88286]: WARNING cinder.quota [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:21:39 devstack cinder-volume[88286]: WARNING cinder.quota [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Created reservations ['a6a00750-9439-4c8b-b556-8765072673aa', '88b3838e-3d8e-4aef-9e07-65e44b21a40e', 'ca2843d2-d2a1-4c0e-9057-4cf8217a7ddd', 'f7ac299c-22db-4fee-9c49-1c7ef59a04bd'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:39 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:21:39 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:40 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.371s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:40 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:21:40 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Deleted volume successfully. Jul 28 16:21:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-25d924ed-2b9e-4924-b9f4-94dce503946c tempest-VolumesAdminNegativeTest-1296625335 None] Lock "cinder-14f56a51-cc63-4cde-8853-aa21cd49ce46-delete_volume" released by "delete_volume" :: held 4.200s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:41 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:21:41 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:41 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.575s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:21:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:21:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-69f78f6f-0095-4aa8-ae2e-89c2b08abc91 req-229cc7ce-477d-4228-ade0-7b433d25a579 tempest-DeleteServersTestJSON-524519865 None] Terminate volume connection completed successfully. Jul 28 16:21:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-69f78f6f-0095-4aa8-ae2e-89c2b08abc91 req-229cc7ce-477d-4228-ade0-7b433d25a579 tempest-DeleteServersTestJSON-524519865 None] Deleting attachment 27d8ee3b-f02b-4fc8-b163-66f1f43adf13. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Acquiring lock "cinder-0e9c700d-74e2-4d85-99de-4d81c0a590d3-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Lock "cinder-0e9c700d-74e2-4d85-99de-4d81c0a590d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Acquiring lock "cinder-quobyte-0e9c700d-74e2-4d85-99de-4d81c0a590d3" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Lock "cinder-quobyte-0e9c700d-74e2-4d85-99de-4d81c0a590d3" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[03862165-f21b-452a-8af9-f8a20ef3a3ba]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:45 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 Jul 28 16:21:45 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:45 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3" returned: 0 in 0.508s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:45 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3 Jul 28 16:21:45 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:46 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e9c700d-74e2-4d85-99de-4d81c0a590d3" returned: 0 in 0.313s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Lock "cinder-quobyte-0e9c700d-74e2-4d85-99de-4d81c0a590d3" released by "delete_volume" :: held 0.920s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Created reservations ['4141e305-d298-4aef-a94b-1ef547c0896e', 'ebc78f73-2df3-4814-b00a-17388bca2d5e', '8de20999-98f3-4cac-bc1d-deed9468dd4c', '5a07af9a-1dbf-41ed-9bdc-1ee582daa33b'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:46 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:21:46 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:46 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.319s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:21:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Deleted volume successfully. Jul 28 16:21:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-24504698-658c-4e5b-934d-41cc17f2fe3d tempest-DeleteServersTestJSON-524519865 None] Lock "cinder-0e9c700d-74e2-4d85-99de-4d81c0a590d3-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Flow 'volume_create_manager' (a2caac2a-3a47-4c89-b9e4-d88ca32d446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d179fe-65e3-4cc2-98a0-a9fd49c1d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d179fe-65e3-4cc2-98a0-a9fd49c1d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1979088502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41359699-860e-4af0-bf52-1635df1ff55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad307ab5fac4aec873732feed14c070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:21:50Z,use_quota=True,user_id='91e089101aba4f36900f25248b9185f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d538e957-fb7a-4e97-b703-b10313323808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d538e957-fb7a-4e97-b703-b10313323808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91326732-2f10-434f-8a63-1451c3743f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91326732-2f10-434f-8a63-1451c3743f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41359699-860e-4af0-bf52-1635df1ff55a', 'volume_name': 'volume-41359699-860e-4af0-bf52-1635df1ff55a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f2d0e0-539e-4efb-ab56-71349b055d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f2d0e0-539e-4efb-ab56-71349b055d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e192c35a-b658-41b1-a4a7-480f51b8e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Volume 41359699-860e-4af0-bf52-1635df1ff55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41359699-860e-4af0-bf52-1635df1ff55a', 'volume_size': 1} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1979088502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41359699-860e-4af0-bf52-1635df1ff55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad307ab5fac4aec873732feed14c070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:21:50Z,use_quota=True,user_id='91e089101aba4f36900f25248b9185f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Creating volume 41359699-860e-4af0-bf52-1635df1ff55a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:21:50 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:50 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a 1073741824 Jul 28 16:21:50 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:50 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a 1073741824" returned: 0 in 0.519s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:21:50 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a Jul 28 16:21:50 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:21:51 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Jul 28 16:21:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a" returned: 0 in 0.387s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:21:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:21:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:21:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e192c35a-b658-41b1-a4a7-480f51b8e58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41359699-860e-4af0-bf52-1635df1ff55a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be710f3-452f-43cd-b783-68e4f17ee00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:21:51 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Volume volume-41359699-860e-4af0-bf52-1635df1ff55a (41359699-860e-4af0-bf52-1635df1ff55a): created successfully Jul 28 16:21:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be710f3-452f-43cd-b783-68e4f17ee00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:21:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Flow 'volume_create_manager' (a2caac2a-3a47-4c89-b9e4-d88ca32d446a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:21:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ad58f922-4ea7-41b0-a05c-4e6cfbdb88ae tempest-AttachVolumeShelveTestJSON-256554819 None] Created volume successfully. Jul 28 16:22:01 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=28,cinder:SELECT=22,cinder:INSERT=4 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:22:01 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=5 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:22:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-96576fa6-f49d-4133-bd38-913f7bc3c3d3 req-d06c6261-ee59-4908-aaa7-02fe5becc65f tempest-AttachVolumeShelveTestJSON-256554819 None] No connector for attachment e9bf09ac-a7f8-41c4-b97c-6d26172a8cf4; skipping storage backend terminate_connection call. {{(pid=88286) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 28 16:22:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-96576fa6-f49d-4133-bd38-913f7bc3c3d3 req-d06c6261-ee59-4908-aaa7-02fe5becc65f tempest-AttachVolumeShelveTestJSON-256554819 None] Deleting attachment e9bf09ac-a7f8-41c4-b97c-6d26172a8cf4. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:22:25 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:22:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:22:41 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:22:41 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:22:41 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.795s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:22:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Flow 'volume_create_manager' (9196ab43-8046-4669-88ef-77c0aaf0adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fea1f0-3d9c-45b2-9ee2-6e8387be76ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fea1f0-3d9c-45b2-9ee2-6e8387be76ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1559277968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e2df5e-900d-498c-ad51-9ce5bf031d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b49935794c041eea0ade28a5063dbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:22:53Z,use_quota=True,user_id='58a02688e293455f98a3854ff73f16a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569be83a-6142-488f-a0cb-d351087eb4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569be83a-6142-488f-a0cb-d351087eb4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4189a-2482-4e1f-859f-62ee640ccf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4189a-2482-4e1f-859f-62ee640ccf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e2df5e-900d-498c-ad51-9ce5bf031d4a', 'volume_name': 'volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34fc6a7-04f5-4359-a5f9-fd9c70f318cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34fc6a7-04f5-4359-a5f9-fd9c70f318cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aff41ef-5cb8-4a70-b4d4-01492ada9eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:22:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Volume f4e2df5e-900d-498c-ad51-9ce5bf031d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a', 'volume_size': 1} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1559277968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e2df5e-900d-498c-ad51-9ce5bf031d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b49935794c041eea0ade28a5063dbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:22:53Z,use_quota=True,user_id='58a02688e293455f98a3854ff73f16a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Creating volume f4e2df5e-900d-498c-ad51-9ce5bf031d4a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:22:52 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:22:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:22:52 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a 1073741824 Jul 28 16:22:52 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:22:53 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Jul 28 16:22:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a 1073741824" returned: 0 in 0.662s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:22:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:22:53 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a Jul 28 16:22:53 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:22:54 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 28 16:22:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a" returned: 0 in 0.583s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:22:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:22:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:22:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aff41ef-5cb8-4a70-b4d4-01492ada9eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:22:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a26c61-a8c2-44ba-a1f2-6274ba884bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:22:54 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Volume volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a (f4e2df5e-900d-498c-ad51-9ce5bf031d4a): created successfully Jul 28 16:22:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a26c61-a8c2-44ba-a1f2-6274ba884bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:22:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Flow 'volume_create_manager' (9196ab43-8046-4669-88ef-77c0aaf0adce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:22:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3513ecd1-407e-42f2-a79b-119d2c0edb42 tempest-ServerRescueNegativeTestJSON-1394342305 None] Created volume successfully. Jul 28 16:23:04 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:23:04 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Flow 'volume_create_manager' (c892e233-cdb4-429e-9392-4acf88ccbe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb88005-530a-4658-8f19-1e07d4d2a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb88005-530a-4658-8f19-1e07d4d2a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1221556548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebeb353-4a33-40b1-883a-434a828a223d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cf284a2b8e46899d7e3dffb686bce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:08Z,use_quota=True,user_id='a0a46fb8043f4f7b908d64074fff5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d9bc00-3868-4232-8252-4c2b05aaeab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d9bc00-3868-4232-8252-4c2b05aaeab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e0fea2-654b-4778-aa1b-400684e7881f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e0fea2-654b-4778-aa1b-400684e7881f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebeb353-4a33-40b1-883a-434a828a223d', 'volume_name': 'volume-5ebeb353-4a33-40b1-883a-434a828a223d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fb821b-cfe2-48a9-8adf-82750a2bac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fb821b-cfe2-48a9-8adf-82750a2bac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4767d4f7-f6d6-4f4a-bb61-ef42f55d720c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Volume 5ebeb353-4a33-40b1-883a-434a828a223d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebeb353-4a33-40b1-883a-434a828a223d', 'volume_size': 1} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1221556548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebeb353-4a33-40b1-883a-434a828a223d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cf284a2b8e46899d7e3dffb686bce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:08Z,use_quota=True,user_id='a0a46fb8043f4f7b908d64074fff5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Creating volume 5ebeb353-4a33-40b1-883a-434a828a223d {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:23:08 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:23:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:08 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d 1073741824 Jul 28 16:23:08 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:09 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d 1073741824" returned: 0 in 0.660s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:09 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d Jul 28 16:23:09 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Acquiring lock "cinder-f4e2df5e-900d-498c-ad51-9ce5bf031d4a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:23:09 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Flow 'volume_create_manager' (a2aed804-b8db-40fe-adca-c4805da12340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5767243e-582b-43f5-8be6-7a599a99f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "cinder-f4e2df5e-900d-498c-ad51-9ce5bf031d4a-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d" returned: 0 in 0.617s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5767243e-582b-43f5-8be6-7a599a99f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1147672168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f402f90a-b6d8-4cf9-b314-ac3c094c0a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09239308aa1d41a39605636c132a2c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:09Z,use_quota=True,user_id='bba4e04edafa402d8027207224737d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4520428c-77fe-4b91-9bf8-a5ff46ba0377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4520428c-77fe-4b91-9bf8-a5ff46ba0377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9101d1a-6100-4210-91bf-01bf20ca7eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9101d1a-6100-4210-91bf-01bf20ca7eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f402f90a-b6d8-4cf9-b314-ac3c094c0a66', 'volume_name': 'volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549ceacc-1851-410a-8630-0bbc8e0460ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549ceacc-1851-410a-8630-0bbc8e0460ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d831977-fa05-4390-8f23-933cdefd35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:09 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Volume f402f90a-b6d8-4cf9-b314-ac3c094c0a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66', 'volume_size': 1} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1147672168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f402f90a-b6d8-4cf9-b314-ac3c094c0a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09239308aa1d41a39605636c132a2c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:09Z,use_quota=True,user_id='bba4e04edafa402d8027207224737d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Creating volume f402f90a-b6d8-4cf9-b314-ac3c094c0a66 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:23:09 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:09 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 1073741824 Jul 28 16:23:09 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4767d4f7-f6d6-4f4a-bb61-ef42f55d720c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebeb353-4a33-40b1-883a-434a828a223d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74be4361-cd59-47f9-83a7-233bc6e69882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Acquiring lock "cinder-quobyte-f4e2df5e-900d-498c-ad51-9ce5bf031d4a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:23:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Volume volume-5ebeb353-4a33-40b1-883a-434a828a223d (5ebeb353-4a33-40b1-883a-434a828a223d): created successfully Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74be4361-cd59-47f9-83a7-233bc6e69882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Flow 'volume_create_manager' (c892e233-cdb4-429e-9392-4acf88ccbe89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "cinder-quobyte-f4e2df5e-900d-498c-ad51-9ce5bf031d4a" acquired by "delete_volume" :: waited 0.085s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:23:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-629ce816-aa7d-4050-8253-9479955e185d tempest-TaggedAttachmentsTest-1010033503 None] Created volume successfully. Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be83ff-d2a8-4848-83a0-8d657e3fc4bc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:10 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a Jul 28 16:23:10 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:10 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 1073741824" returned: 0 in 0.903s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:10 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 Jul 28 16:23:10 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:10 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a" returned: 0 in 0.794s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:11 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a Jul 28 16:23:11 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:11 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4e2df5e-900d-498c-ad51-9ce5bf031d4a" returned: 0 in 0.607s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:11 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "cinder-quobyte-f4e2df5e-900d-498c-ad51-9ce5bf031d4a" released by "delete_volume" :: held 1.494s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66" returned: 0 in 0.756s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d831977-fa05-4390-8f23-933cdefd35c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85eac6fe-fcc9-40b4-8439-a0d79c04af23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:11 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Volume volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 (f402f90a-b6d8-4cf9-b314-ac3c094c0a66): created successfully Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85eac6fe-fcc9-40b4-8439-a0d79c04af23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Flow 'volume_create_manager' (a2aed804-b8db-40fe-adca-c4805da12340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8f2b2b6a-197b-41ca-8693-1871336726f2 tempest-ServerActionsTestOtherA-853999548 None] Created volume successfully. Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Created reservations ['60856510-b53c-4da8-9f51-f4cc59231d0e', '449b770b-014a-49b9-9c5f-4eb5b16abd32', '4891c0d8-42eb-434d-8f60-5a1f312fcbbf', 'cd426a3a-f45b-48f9-afd3-d76e03d24209'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:11 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:23:11 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:12 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.457s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:12 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:23:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Deleted volume successfully. Jul 28 16:23:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-374ff668-365d-4f10-9e25-d55027e2d79c tempest-ServerRescueNegativeTestJSON-1394342305 None] Lock "cinder-f4e2df5e-900d-498c-ad51-9ce5bf031d4a-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:23:21 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=12,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:23:22 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=7,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:23:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Acquiring lock "cinder-41359699-860e-4af0-bf52-1635df1ff55a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:23:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "cinder-41359699-860e-4af0-bf52-1635df1ff55a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:23:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Acquiring lock "cinder-quobyte-41359699-860e-4af0-bf52-1635df1ff55a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:23:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "cinder-quobyte-41359699-860e-4af0-bf52-1635df1ff55a" acquired by "delete_volume" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:23:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a97b21-a056-4f8f-8c21-8907c7b995ec]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:23:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:40 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a Jul 28 16:23:40 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:40 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a" returned: 0 in 0.615s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:40 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a Jul 28 16:23:40 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:41 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41359699-860e-4af0-bf52-1635df1ff55a" returned: 0 in 0.410s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:41 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "cinder-quobyte-41359699-860e-4af0-bf52-1635df1ff55a" released by "delete_volume" :: held 1.165s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:23:41 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Created reservations ['e9cc2e21-ffc6-4b99-a4fd-9f7ced57dba9', '2919ee81-44cc-4858-8458-d23ddf5f293c', 'c3ab78e9-589e-4cb3-b0fd-08bc16550a2b', '4135563e-1f86-40c5-b2a8-82456a6f4af5'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:41 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:23:41 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:41 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.362s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:23:41 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.392s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:23:41 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Deleted volume successfully. Jul 28 16:23:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3a7a715c-a563-418c-a876-17813272b0ba tempest-AttachVolumeShelveTestJSON-256554819 None] Lock "cinder-41359699-860e-4af0-bf52-1635df1ff55a-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:23:51 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=4,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:23:51 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Flow 'volume_create_manager' (e1305c3f-4001-48f4-86be-7ac3814153bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bd10e9-fa7a-4471-b705-af20a24f2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bd10e9-fa7a-4471-b705-af20a24f2824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1061147433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee0386d-747f-4d9e-8ef0-ee4d002bb9d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ae18c0281c14429bf61180d3edcb4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:52Z,use_quota=True,user_id='9e3119f4381f43638c946818e2dae80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b44f1e-387c-49c8-8d81-e63aec90ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b44f1e-387c-49c8-8d81-e63aec90ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2695fe7-6107-4bc1-aa2f-90ec8e87e7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2695fe7-6107-4bc1-aa2f-90ec8e87e7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee0386d-747f-4d9e-8ef0-ee4d002bb9d1', 'volume_name': 'volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2411e668-a29c-4d60-b61d-0c3e193fb484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2411e668-a29c-4d60-b61d-0c3e193fb484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd05c4c-cc23-4a9d-b8fb-06adf8d9fb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Volume dee0386d-747f-4d9e-8ef0-ee4d002bb9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1', 'volume_size': 1} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1061147433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee0386d-747f-4d9e-8ef0-ee4d002bb9d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ae18c0281c14429bf61180d3edcb4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:52Z,use_quota=True,user_id='9e3119f4381f43638c946818e2dae80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Creating volume dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:23:52 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:52 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 1073741824 Jul 28 16:23:52 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:52 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 1073741824" returned: 0 in 0.459s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:52 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 Jul 28 16:23:52 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:53 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1" returned: 0 in 0.276s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:23:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd05c4c-cc23-4a9d-b8fb-06adf8d9fb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea06e35a-1515-4862-8248-8c1fef7b436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Volume volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 (dee0386d-747f-4d9e-8ef0-ee4d002bb9d1): created successfully Jul 28 16:23:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea06e35a-1515-4862-8248-8c1fef7b436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Flow 'volume_create_manager' (e1305c3f-4001-48f4-86be-7ac3814153bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-94d6a2e5-f099-42b5-be3b-170e900ac616 tempest-VolumesTestJSON-1328792617 None] Created volume successfully. Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Flow 'volume_create_manager' (6b05a251-a672-4dea-ab84-17c7dccb9042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cca590-ede0-4952-bbc1-666b822abbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cca590-ede0-4952-bbc1-666b822abbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1123433481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ae18c0281c14429bf61180d3edcb4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:56Z,use_quota=True,user_id='9e3119f4381f43638c946818e2dae80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f2e8e9-b7fb-482e-bc27-a702bfc2069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f2e8e9-b7fb-482e-bc27-a702bfc2069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e03f4c-2777-4d26-a9f5-4b3906083798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e03f4c-2777-4d26-a9f5-4b3906083798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4', 'volume_name': 'volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571e5405-0437-471f-a713-e1da17e5fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571e5405-0437-471f-a713-e1da17e5fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57af1c4c-9830-4fd5-a65d-427efaac9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:56 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Volume 0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4', 'volume_size': 1} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1123433481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ae18c0281c14429bf61180d3edcb4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:56Z,use_quota=True,user_id='9e3119f4381f43638c946818e2dae80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Creating volume 0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:23:56 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:56 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 1073741824 Jul 28 16:23:56 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-87355323-ded9-417c-9680-eafe7950bf89 req-2eed0a73-377c-44dd-90e5-cd847e51b25f tempest-ServerActionsTestOtherA-853999548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:56 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 1073741824" returned: 0 in 0.622s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:56 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 Jul 28 16:23:56 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:23:57 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4" returned: 0 in 0.377s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-87355323-ded9-417c-9680-eafe7950bf89 req-2eed0a73-377c-44dd-90e5-cd847e51b25f tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.906s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57af1c4c-9830-4fd5-a65d-427efaac9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d322df2-f575-4125-946f-fc3baacdd1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-87355323-ded9-417c-9680-eafe7950bf89 req-2eed0a73-377c-44dd-90e5-cd847e51b25f tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:57 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Volume volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 (0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4): created successfully Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d322df2-f575-4125-946f-fc3baacdd1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Flow 'volume_create_manager' (6b05a251-a672-4dea-ab84-17c7dccb9042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3adf1aff-d77f-4170-9e53-353c590ce907 tempest-VolumesTestJSON-1328792617 None] Created volume successfully. Jul 28 16:23:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-87355323-ded9-417c-9680-eafe7950bf89 req-2eed0a73-377c-44dd-90e5-cd847e51b25f tempest-ServerActionsTestOtherA-853999548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e4ff955-0f2c-4b51-8f25-267beb12afa4', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:23:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-87355323-ded9-417c-9680-eafe7950bf89 req-2eed0a73-377c-44dd-90e5-cd847e51b25f tempest-ServerActionsTestOtherA-853999548 None] attachment_update completed successfully. Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Flow 'volume_create_manager' (4de1b577-c6fc-4cc4-920f-3deb1a49a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7578525e-b015-4d0b-b920-7bb4b172bd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7578525e-b015-4d0b-b920-7bb4b172bd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235493080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05db66c-f8a5-4071-a769-ff45e9a352ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ae18c0281c14429bf61180d3edcb4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:59Z,use_quota=True,user_id='9e3119f4381f43638c946818e2dae80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c4a404-1c5e-4e01-b883-1856ee1c2a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c4a404-1c5e-4e01-b883-1856ee1c2a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44292c12-5540-422c-a9c6-d23d58625c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44292c12-5540-422c-a9c6-d23d58625c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05db66c-f8a5-4071-a769-ff45e9a352ca', 'volume_name': 'volume-f05db66c-f8a5-4071-a769-ff45e9a352ca', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e612f4-06fb-4425-8876-42f6903fadca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e612f4-06fb-4425-8876-42f6903fadca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0024fd4a-a086-423d-940c-67544b0142a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:23:59 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Volume f05db66c-f8a5-4071-a769-ff45e9a352ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05db66c-f8a5-4071-a769-ff45e9a352ca', 'volume_size': 1} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235493080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05db66c-f8a5-4071-a769-ff45e9a352ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ae18c0281c14429bf61180d3edcb4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:23:59Z,use_quota=True,user_id='9e3119f4381f43638c946818e2dae80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Creating volume f05db66c-f8a5-4071-a769-ff45e9a352ca {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:23:59 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:23:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:23:59 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca 1073741824 Jul 28 16:23:59 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:00 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca 1073741824" returned: 0 in 0.786s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:00 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca Jul 28 16:24:00 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:00 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca" returned: 0 in 0.337s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0024fd4a-a086-423d-940c-67544b0142a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05db66c-f8a5-4071-a769-ff45e9a352ca', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61bc5bd-1841-4646-9d17-47685e02e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:00 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Volume volume-f05db66c-f8a5-4071-a769-ff45e9a352ca (f05db66c-f8a5-4071-a769-ff45e9a352ca): created successfully Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61bc5bd-1841-4646-9d17-47685e02e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Flow 'volume_create_manager' (4de1b577-c6fc-4cc4-920f-3deb1a49a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:24:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8c8d969f-819c-459e-8584-b31d750d4f70 tempest-VolumesTestJSON-1328792617 None] Created volume successfully. Jul 28 16:24:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6e105249-189d-4211-91c1-913fab8cbf10 req-6f244a5b-43e2-4874-a100-be6bb59dc555 tempest-TaggedAttachmentsTest-1010033503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6e105249-189d-4211-91c1-913fab8cbf10 req-6f244a5b-43e2-4874-a100-be6bb59dc555 tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6e105249-189d-4211-91c1-913fab8cbf10 req-6f244a5b-43e2-4874-a100-be6bb59dc555 tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-6e105249-189d-4211-91c1-913fab8cbf10 req-6f244a5b-43e2-4874-a100-be6bb59dc555 tempest-TaggedAttachmentsTest-1010033503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-5ebeb353-4a33-40b1-883a-434a828a223d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9086d97-28f3-4623-bddf-8afd78182ea3', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:24:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-6e105249-189d-4211-91c1-913fab8cbf10 req-6f244a5b-43e2-4874-a100-be6bb59dc555 tempest-TaggedAttachmentsTest-1010033503 None] attachment_update completed successfully. Jul 28 16:24:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "cinder-f05db66c-f8a5-4071-a769-ff45e9a352ca-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-f05db66c-f8a5-4071-a769-ff45e9a352ca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "cinder-quobyte-f05db66c-f8a5-4071-a769-ff45e9a352ca" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-quobyte-f05db66c-f8a5-4071-a769-ff45e9a352ca" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ff377-e101-4fe3-8d99-89a373beccc6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:03 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca Jul 28 16:24:03 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-bb2a0bd9-26ed-46b3-b466-93bc3bd7ed94 req-09a3076c-ea28-4fa5-b751-23198801f3c6 tempest-ServerActionsTestOtherA-853999548 None] Terminate volume connection completed successfully. Jul 28 16:24:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-bb2a0bd9-26ed-46b3-b466-93bc3bd7ed94 req-09a3076c-ea28-4fa5-b751-23198801f3c6 tempest-ServerActionsTestOtherA-853999548 None] Deleting attachment 7e4ff955-0f2c-4b51-8f25-267beb12afa4. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:24:04 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca" returned: 0 in 0.586s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:04 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca Jul 28 16:24:04 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:04 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f05db66c-f8a5-4071-a769-ff45e9a352ca" returned: 0 in 0.567s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-quobyte-f05db66c-f8a5-4071-a769-ff45e9a352ca" released by "delete_volume" :: held 1.262s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Created reservations ['a627f85c-a619-4aa8-874c-0126c7d101f3', '96c79c43-c39c-4264-ba0d-746a2ae5fb76', '3a04e40e-96ff-444f-80f4-4292a28fe3ef', '2f79edad-71d7-464f-bfd6-51e2a0135947'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:04 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:24:04 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-bb2a0bd9-26ed-46b3-b466-93bc3bd7ed94 req-66382aa4-013d-4b7a-a698-2a521a0e7e68 tempest-ServerActionsTestOtherA-853999548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-bb2a0bd9-26ed-46b3-b466-93bc3bd7ed94 req-66382aa4-013d-4b7a-a698-2a521a0e7e68 tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-bb2a0bd9-26ed-46b3-b466-93bc3bd7ed94 req-66382aa4-013d-4b7a-a698-2a521a0e7e68 tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-bb2a0bd9-26ed-46b3-b466-93bc3bd7ed94 req-66382aa4-013d-4b7a-a698-2a521a0e7e68 tempest-ServerActionsTestOtherA-853999548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7c976b9-ce80-4bce-9031-dfb54770a25c', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:24:05 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-bb2a0bd9-26ed-46b3-b466-93bc3bd7ed94 req-66382aa4-013d-4b7a-a698-2a521a0e7e68 tempest-ServerActionsTestOtherA-853999548 None] attachment_update completed successfully. Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.633s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:24:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Deleted volume successfully. Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bd18c9e9-b375-483c-8a46-9a678155d0a1 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-f05db66c-f8a5-4071-a769-ff45e9a352ca-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "cinder-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "cinder-quobyte-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-quobyte-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:06 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff5cd3-c620-42ba-a8b1-07776460eef4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:06 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 Jul 28 16:24:06 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:06 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4" returned: 0 in 0.737s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:06 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4 Jul 28 16:24:06 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:07 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4" returned: 0 in 0.592s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-quobyte-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4" released by "delete_volume" :: held 1.432s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Created reservations ['6fac71ba-9718-4a3b-988b-0efe45cb8dd3', '75e62d8e-b7b6-4061-972a-41c5fffbcad4', '60691818-9df9-4414-ad5b-1f192aaa353a', 'f4e4ed3a-0fad-4201-8885-f1ccde3ee374'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-3637bbeb-24fb-4b45-bc92-a403a4ac623d req-c6575de8-6bc7-4660-8c6b-370f02549cf6 tempest-TaggedAttachmentsTest-1010033503 None] Terminate volume connection completed successfully. Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-3637bbeb-24fb-4b45-bc92-a403a4ac623d req-c6575de8-6bc7-4660-8c6b-370f02549cf6 tempest-TaggedAttachmentsTest-1010033503 None] Deleting attachment d9086d97-28f3-4623-bddf-8afd78182ea3. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:08 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:24:08 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "cinder-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "cinder-quobyte-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-quobyte-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1" acquired by "delete_volume" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:08 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.816s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:24:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Deleted volume successfully. Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805a6ab-3464-4399-aa12-52fc6448b8c4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-959336f2-52bc-4013-9079-744ecb0ae758 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-0c62b7f2-06cc-4b0d-abba-eb7c3b68d3d4-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:09 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 Jul 28 16:24:09 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:09 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1" returned: 0 in 0.936s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:09 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1 Jul 28 16:24:09 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:10 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1" returned: 0 in 0.653s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-quobyte-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1" released by "delete_volume" :: held 1.691s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:10 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Created reservations ['c17f842c-89cd-43c6-acaa-453df5609171', 'cb16f892-c265-441f-aa20-2a59b4f51e34', '445406bd-6eb8-421f-bf2c-2bc70e4425ab', 'dd85fa48-9bf2-42aa-91b1-e0430d9f3fed'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:11 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:24:11 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:11 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.567s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:24:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Deleted volume successfully. Jul 28 16:24:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55afa273-41a3-4960-aee3-c26411c73c30 tempest-VolumesTestJSON-1328792617 None] Lock "cinder-dee0386d-747f-4d9e-8ef0-ee4d002bb9d1-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-53df48d0-2d82-41d5-85f4-bb8785e94b6d tempest-GroupSnapshotsV319Test-864752042 None] Group tempest-GroupSnapshotsV319Test-Group-1980675616: creating Jul 28 16:24:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-53df48d0-2d82-41d5-85f4-bb8785e94b6d tempest-GroupSnapshotsV319Test-864752042 None] Group tempest-GroupSnapshotsV319Test-Group-1980675616: created successfully Jul 28 16:24:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-53df48d0-2d82-41d5-85f4-bb8785e94b6d tempest-GroupSnapshotsV319Test-864752042 None] Create group completed successfully. Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Flow 'volume_create_manager' (4cafd7c4-313e-4f27-9822-316b6b798bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2798dd35-5977-4a82-9952-af1c01b79448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2798dd35-5977-4a82-9952-af1c01b79448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1447617437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=248b9340-ba24-4cb7-af08-8aefb805b6dc,host='devstack@QuobyteHD#QuobyteHD',id=00cf6030-2bb8-474f-aa88-bbccdf32a258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8028bfe5ae1f4e5cab90ae39f66fce08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:24:20Z,use_quota=True,user_id='03f7e3764aa2469e9781c48bd47c75bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15022114-7b28-46de-95e5-a8e311ded808),volume_type_id=15022114-7b28-46de-95e5-a8e311ded808)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2f90b-3d63-4424-bbd0-ba9c181c7189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2f90b-3d63-4424-bbd0-ba9c181c7189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1cbc5f-ef76-4474-bfce-8c4463b86b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1cbc5f-ef76-4474-bfce-8c4463b86b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cf6030-2bb8-474f-aa88-bbccdf32a258', 'volume_name': 'volume-00cf6030-2bb8-474f-aa88-bbccdf32a258', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a45e4c8-74f3-4d10-b394-2c9382a09c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a45e4c8-74f3-4d10-b394-2c9382a09c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6677785a-9f19-4d58-b40b-ed6c4cde5894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:20 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Volume 00cf6030-2bb8-474f-aa88-bbccdf32a258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cf6030-2bb8-474f-aa88-bbccdf32a258', 'volume_size': 1} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=248b9340-ba24-4cb7-af08-8aefb805b6dc,created_at=2026-07-28T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1447617437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=248b9340-ba24-4cb7-af08-8aefb805b6dc,host='devstack@QuobyteHD#QuobyteHD',id=00cf6030-2bb8-474f-aa88-bbccdf32a258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8028bfe5ae1f4e5cab90ae39f66fce08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:24:20Z,use_quota=True,user_id='03f7e3764aa2469e9781c48bd47c75bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15022114-7b28-46de-95e5-a8e311ded808),volume_type_id=15022114-7b28-46de-95e5-a8e311ded808)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Creating volume 00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:24:20 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:20 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 1073741824 Jul 28 16:24:20 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:20 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 1073741824" returned: 0 in 0.490s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:20 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 Jul 28 16:24:20 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:21 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258" returned: 0 in 0.281s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6677785a-9f19-4d58-b40b-ed6c4cde5894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cf6030-2bb8-474f-aa88-bbccdf32a258', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffe47af-1a53-4eb9-9708-fd64e2b8a1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:21 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Volume volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 (00cf6030-2bb8-474f-aa88-bbccdf32a258): created successfully Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffe47af-1a53-4eb9-9708-fd64e2b8a1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Flow 'volume_create_manager' (4cafd7c4-313e-4f27-9822-316b6b798bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:24:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2a0e08cc-299c-4d1b-99f5-e4a1bacf63dc tempest-GroupSnapshotsV319Test-864752042 None] Created volume successfully. Jul 28 16:24:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] GroupSnapshot 4cd8ed6d-fab5-49f4-8ed4-f7716513a5c3: creating. Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Group snapshot 4cd8ed6d-fab5-49f4-8ed4-f7716513a5c3: creating. {{(pid=88286) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Acquiring lock "cinder-5ebeb353-4a33-40b1-883a-434a828a223d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Lock "cinder-5ebeb353-4a33-40b1-883a-434a828a223d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Creating offline snapshot b28b0ab0-5e98-4ca6-a73f-822c0b817db0 of volume 00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[13706fed-2aa5-42ca-80b0-f818f56cb73b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Acquiring lock "cinder-quobyte-5ebeb353-4a33-40b1-883a-434a828a223d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Lock "cinder-quobyte-5ebeb353-4a33-40b1-883a-434a828a223d" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a0f9c-192b-4247-b264-23dd673d4196]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:22 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 Jul 28 16:24:22 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:22 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d Jul 28 16:24:22 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:22 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258" returned: 0 in 0.402s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:22 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 1G Jul 28 16:24:22 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:22 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d" returned: 0 in 0.378s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:22 devstack sudo[92594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d Jul 28 16:24:22 devstack sudo[92594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:22 devstack sudo[92594]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5ebeb353-4a33-40b1-883a-434a828a223d" returned: 0 in 0.255s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Lock "cinder-quobyte-5ebeb353-4a33-40b1-883a-434a828a223d" released by "delete_volume" :: held 0.673s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Created reservations ['c9f60f76-a6a1-4663-8fd4-31405a118ab0', 'b647034a-10d2-4d77-baf6-00c34592b354', 'ec129ffb-66b3-4d28-a7fe-77604aa72828', '4563073b-4e2b-45a0-8b71-9145bfe4e732'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:22 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 1G" returned: 0 in 0.419s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:22 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 Jul 28 16:24:22 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:22 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:24:22 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:23 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:24:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Deleted volume successfully. Jul 28 16:24:23 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0" returned: 0 in 0.353s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:23 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cd9e462d-fe29-4e81-a1ef-f347e4c71c32 tempest-TaggedAttachmentsTest-1010033503 None] Lock "cinder-5ebeb353-4a33-40b1-883a-434a828a223d-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:23 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 Jul 28 16:24:23 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:23 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:23 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.info Jul 28 16:24:23 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:23 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.info" returned: 0 in 0.301s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:23 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:23 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.info Jul 28 16:24:23 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:23 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.info" returned: 0 in 0.303s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f5140945-5515-4fbc-bd1f-9ec3becc0839 tempest-GroupSnapshotsV319Test-864752042 None] group_snapshot 4cd8ed6d-fab5-49f4-8ed4-f7716513a5c3: created successfully Jul 28 16:24:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] group_snapshot 4cd8ed6d-fab5-49f4-8ed4-f7716513a5c3: deleting Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] group_snapshot 4cd8ed6d-fab5-49f4-8ed4-f7716513a5c3: deleting {{(pid=88286) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Acquiring lock "cinder-quobyte-00cf6030-2bb8-474f-aa88-bbccdf32a258" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "cinder-quobyte-00cf6030-2bb8-474f-aa88-bbccdf32a258" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Acquiring lock "cinder-quobyte-b28b0ab0-5e98-4ca6-a73f-822c0b817db0" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "cinder-quobyte-b28b0ab0-5e98-4ca6-a73f-822c0b817db0" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Deleting offline snapshot b28b0ab0-5e98-4ca6-a73f-822c0b817db0 of volume 00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] snapshot_file for this snap is: volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[975950e5-a2a3-428b-abbc-18ab454fb4f2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:25 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 Jul 28 16:24:25 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:26 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0" returned: 0 in 0.614s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00cf6030-2bb8-474f-aa88-bbccdf32a258(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:24:26 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c3928-7c70-4db2-9a21-45817d888592]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:26 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 Jul 28 16:24:26 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:26 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258" returned: 0 in 0.429s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:26 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 Jul 28 16:24:26 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:27 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0" returned: 0 in 0.484s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:27 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0 Jul 28 16:24:27 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:27 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258.b28b0ab0-5e98-4ca6-a73f-822c0b817db0" returned: 0 in 0.284s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "cinder-quobyte-b28b0ab0-5e98-4ca6-a73f-822c0b817db0" released by "_delete_snapshot" :: held 1.946s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Lock "cinder-quobyte-00cf6030-2bb8-474f-aa88-bbccdf32a258" released by "delete_snapshot" :: held 1.997s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:27 devstack cinder-volume[88286]: WARNING cinder.quota [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-965066426 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-965066426, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:24:27 devstack cinder-volume[88286]: WARNING cinder.quota [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-965066426 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-965066426, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:24:27 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] Created reservations ['467254ca-d545-40c3-ad76-e883f7e38f39', '0f89eb0a-56c4-4755-862e-4dcf0e53f7eb', '9133b019-908c-436e-a781-0f315cfef794', '1ad24de6-9010-4976-aa51-49244c8e67eb'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:27 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-914f391c-45f6-433e-8e7d-b7a3099427dc tempest-GroupSnapshotsV319Test-864752042 None] group_snapshot 4cd8ed6d-fab5-49f4-8ed4-f7716513a5c3: deleted successfully Jul 28 16:24:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Acquiring lock "cinder-quobyte-00cf6030-2bb8-474f-aa88-bbccdf32a258" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Lock "cinder-quobyte-00cf6030-2bb8-474f-aa88-bbccdf32a258" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:28 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b3d7c-4547-42bf-8229-2f19916ad912]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:28 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 Jul 28 16:24:28 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:28 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258" returned: 0 in 0.381s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:28 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258 Jul 28 16:24:28 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:29 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00cf6030-2bb8-474f-aa88-bbccdf32a258" returned: 0 in 0.296s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Lock "cinder-quobyte-00cf6030-2bb8-474f-aa88-bbccdf32a258" released by "delete_volume" :: held 0.757s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Created reservations ['64291361-070a-41df-8734-65f4faf7bff9'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:29 devstack cinder-volume[88286]: WARNING cinder.quota [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-965066426 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-965066426, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Created reservations ['360f3067-5cb0-4f13-a663-995117bf83db', '8b7805d0-fa37-4023-bb1e-aa94df594325', 'a16124d0-ec56-4197-8002-aadb73109684', 'b5e64fba-da5c-4ec0-8383-25538c11c56c'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:29 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:24:29 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:29 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.258s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:29 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:24:29 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b7360a47-d969-4c28-a97c-49524761d98f tempest-GroupSnapshotsV319Test-864752042 None] Delete group completed successfully. Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Flow 'volume_create_manager' (a7ef3538-83a4-4a1d-9016-27fa7afd922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dcb11a-4a8f-460c-a39c-be9db8cc2b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dcb11a-4a8f-460c-a39c-be9db8cc2b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-582179987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c6a244-a403-49be-b31e-7736d4d0b09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f72a89474434d5494b5e4275aaa32ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:24:31Z,use_quota=True,user_id='a09aa0ee14d64675a32ddfa5a46fce5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5edaa42-60a4-452d-994e-a58873aebd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5edaa42-60a4-452d-994e-a58873aebd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edf1aee-7fb0-4278-843e-91b4f6a08d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edf1aee-7fb0-4278-843e-91b4f6a08d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c6a244-a403-49be-b31e-7736d4d0b09a', 'volume_name': 'volume-73c6a244-a403-49be-b31e-7736d4d0b09a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca7c778-6811-4ae0-86f4-3be3a1cbaba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca7c778-6811-4ae0-86f4-3be3a1cbaba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd69c3c0-ed0d-4818-8a06-578995b6d9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:31 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Volume 73c6a244-a403-49be-b31e-7736d4d0b09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c6a244-a403-49be-b31e-7736d4d0b09a', 'volume_size': 1} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-582179987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c6a244-a403-49be-b31e-7736d4d0b09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f72a89474434d5494b5e4275aaa32ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:24:31Z,use_quota=True,user_id='a09aa0ee14d64675a32ddfa5a46fce5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Creating volume 73c6a244-a403-49be-b31e-7736d4d0b09a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:24:31 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:31 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a 1073741824 Jul 28 16:24:31 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:31 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a 1073741824" returned: 0 in 0.589s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:31 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a Jul 28 16:24:31 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:32 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:24:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd69c3c0-ed0d-4818-8a06-578995b6d9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c6a244-a403-49be-b31e-7736d4d0b09a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fccf77-9583-4be4-9296-a6c77a1bc5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:32 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Volume volume-73c6a244-a403-49be-b31e-7736d4d0b09a (73c6a244-a403-49be-b31e-7736d4d0b09a): created successfully Jul 28 16:24:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fccf77-9583-4be4-9296-a6c77a1bc5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Flow 'volume_create_manager' (a7ef3538-83a4-4a1d-9016-27fa7afd922c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:24:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e2855553-3f00-4d71-8f6c-ca64c37c735e tempest-AttachVolumeNegativeTest-1156938776 None] Created volume successfully. Jul 28 16:24:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-74bd066a-83e4-429a-86ca-4a4f270272d8 req-0de620f2-94d7-48f2-945e-bd947a4b1f71 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-74bd066a-83e4-429a-86ca-4a4f270272d8 req-0de620f2-94d7-48f2-945e-bd947a4b1f71 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-74bd066a-83e4-429a-86ca-4a4f270272d8 req-0de620f2-94d7-48f2-945e-bd947a4b1f71 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-74bd066a-83e4-429a-86ca-4a4f270272d8 req-0de620f2-94d7-48f2-945e-bd947a4b1f71 tempest-AttachVolumeNegativeTest-1156938776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-73c6a244-a403-49be-b31e-7736d4d0b09a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d793cf9-d595-4965-b4fb-4ec73ecad0c6', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:24:34 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-74bd066a-83e4-429a-86ca-4a4f270272d8 req-0de620f2-94d7-48f2-945e-bd947a4b1f71 tempest-AttachVolumeNegativeTest-1156938776 None] attachment_update completed successfully. Jul 28 16:24:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1036bac8-7c50-410a-8267-9cbc793342da tempest-GroupsV314Test-608632194 None] Group tempest-GroupsV314Test-Group-1478428699: creating Jul 28 16:24:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1036bac8-7c50-410a-8267-9cbc793342da tempest-GroupsV314Test-608632194 None] Group tempest-GroupsV314Test-Group-1478428699: created successfully Jul 28 16:24:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1036bac8-7c50-410a-8267-9cbc793342da tempest-GroupsV314Test-608632194 None] Create group completed successfully. Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Flow 'volume_create_manager' (8bab26dc-b2f2-4b8c-b9a9-a643730937d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c811b75b-0313-462f-91a0-9d743b135981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c811b75b-0313-462f-91a0-9d743b135981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258866157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f008aca-e5e8-4fbf-a7e1-71d22ee0ce89,host='devstack@QuobyteHD#QuobyteHD',id=e820cb35-91a5-4289-829c-c034224f624d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bae839431f43b58c10e0e75026cac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:24:39Z,use_quota=True,user_id='01aa0c2764754ffdb946916aec9eb7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3a808cb-68ed-47bd-802c-48b9fba450c2),volume_type_id=b3a808cb-68ed-47bd-802c-48b9fba450c2)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee402f4-b156-4055-b5c9-d67c64b76f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee402f4-b156-4055-b5c9-d67c64b76f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5553e7b-0300-4450-9310-a728bd12c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5553e7b-0300-4450-9310-a728bd12c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e820cb35-91a5-4289-829c-c034224f624d', 'volume_name': 'volume-e820cb35-91a5-4289-829c-c034224f624d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2930bea-c4f3-4e8b-98f7-2c559ba9cc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2930bea-c4f3-4e8b-98f7-2c559ba9cc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcd1c0b-b0a2-4384-8b68-a8d896c54bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:38 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Volume e820cb35-91a5-4289-829c-c034224f624d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e820cb35-91a5-4289-829c-c034224f624d', 'volume_size': 1} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f008aca-e5e8-4fbf-a7e1-71d22ee0ce89,created_at=2026-07-28T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258866157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f008aca-e5e8-4fbf-a7e1-71d22ee0ce89,host='devstack@QuobyteHD#QuobyteHD',id=e820cb35-91a5-4289-829c-c034224f624d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bae839431f43b58c10e0e75026cac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:24:39Z,use_quota=True,user_id='01aa0c2764754ffdb946916aec9eb7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3a808cb-68ed-47bd-802c-48b9fba450c2),volume_type_id=b3a808cb-68ed-47bd-802c-48b9fba450c2)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Creating volume e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:24:38 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:24:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:38 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d 1073741824 Jul 28 16:24:38 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:39 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d 1073741824" returned: 0 in 0.589s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:39 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d Jul 28 16:24:39 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:39 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcd1c0b-b0a2-4384-8b68-a8d896c54bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e820cb35-91a5-4289-829c-c034224f624d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cfa778-4a22-46a6-bda0-af44ab5bb2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:24:39 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Volume volume-e820cb35-91a5-4289-829c-c034224f624d (e820cb35-91a5-4289-829c-c034224f624d): created successfully Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cfa778-4a22-46a6-bda0-af44ab5bb2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:24:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Flow 'volume_create_manager' (8bab26dc-b2f2-4b8c-b9a9-a643730937d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:24:39 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b73da6fd-52dd-434b-9daf-23ac4dbf33bc tempest-GroupsV314Test-608632194 None] Created volume successfully. Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:41 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:24:41 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:41 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.519s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:24:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:24:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:42 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Cloning volume e820cb35-91a5-4289-829c-c034224f624d to volume fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 Jul 28 16:24:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Creating offline snapshot e9f6fb03-64cc-422e-b254-8b7384b5e47c of volume e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:24:42 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442ba83-49ef-46c3-b8eb-dac264092b2a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:42 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d Jul 28 16:24:42 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:42 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d" returned: 0 in 0.557s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:42 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c 1G Jul 28 16:24:42 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:43 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c 1G" returned: 0 in 0.530s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e820cb35-91a5-4289-829c-c034224f624d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:43 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e820cb35-91a5-4289-829c-c034224f624d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c Jul 28 16:24:43 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:43 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e820cb35-91a5-4289-829c-c034224f624d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c" returned: 0 in 0.451s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:43 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:24:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:43 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c Jul 28 16:24:43 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:44 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c" returned: 0 in 0.302s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:44 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.info Jul 28 16:24:44 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:44 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.info" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:44 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:44 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.info Jul 28 16:24:44 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:44 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.info" returned: 0 in 0.345s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Acquiring lock "cinder-quobyte-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] snapshot: e9f6fb03-64cc-422e-b254-8b7384b5e47c, volume: fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6653f474-a569-44fc-84f1-5ab0943b00b9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:45 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c Jul 28 16:24:45 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:45 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c" returned: 0 in 0.442s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e820cb35-91a5-4289-829c-c034224f624d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e133f84-5e13-4900-bf9a-360be41d11ce]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:45 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d Jul 28 16:24:45 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:45 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d" returned: 0 in 0.507s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:24:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:45 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 Jul 28 16:24:45 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:52 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" returned: 0 in 6.525s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbc771b-74d9-41fb-beeb-291b3f0622fe]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:52 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d Jul 28 16:24:52 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:53 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d" returned: 0 in 0.877s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:24:53 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Converted 1024.00 MB image at 156.88 MB/s Jul 28 16:24:53 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:53 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 Jul 28 16:24:53 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:53 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" returned: 0 in 0.318s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" released by "_copy_volume_from_snapshot" :: held 8.793s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=75,cinder:SELECT=79,cinder:INSERT=18,cinder:DELETE=6 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Acquiring lock "cinder-quobyte-e9f6fb03-64cc-422e-b254-8b7384b5e47c" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-e9f6fb03-64cc-422e-b254-8b7384b5e47c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Deleting offline snapshot e9f6fb03-64cc-422e-b254-8b7384b5e47c of volume e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] snapshot_file for this snap is: volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ea1e26-9078-4547-9188-205396fd50dc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:53 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c Jul 28 16:24:53 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:54 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=101,cinder:UPDATE=82,cinder:INSERT=16,cinder:DELETE=4 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:24:54 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c" returned: 0 in 0.648s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e820cb35-91a5-4289-829c-c034224f624d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:24:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc535e29-2ccd-4dde-a963-d86082313c3f]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:54 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d Jul 28 16:24:54 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:54 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d" returned: 0 in 0.447s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:54 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c Jul 28 16:24:54 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:55 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c" returned: 0 in 1.047s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:56 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c Jul 28 16:24:56 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:56 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d.e9f6fb03-64cc-422e-b254-8b7384b5e47c" returned: 0 in 0.387s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-e9f6fb03-64cc-422e-b254-8b7384b5e47c" released by "_delete_snapshot" :: held 2.708s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.266s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:24:56 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1fab23c2-679c-49da-81b0-4d1a480b6bbd tempest-GroupsV314Test-608632194 None] Create group from source-group-3f008aca-e5e8-4fbf-a7e1-71d22ee0ce89 completed successfully. Jul 28 16:24:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Acquiring lock "cinder-quobyte-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:24:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:24:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae00e8-ca9e-48b8-873f-614c7c9eb704]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:24:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:58 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 Jul 28 16:24:58 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:58 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" returned: 0 in 0.690s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:24:58 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9 Jul 28 16:24:58 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:24:59 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 28 16:24:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" returned: 0 in 0.725s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:24:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-fe3a00c0-bbb4-45dd-bbfb-c09b9dbccea9" released by "delete_volume" :: held 1.525s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:24:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Created reservations ['e5bdc900-6b86-403b-8f6f-38f9e9b77655'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:24:59 devstack cinder-volume[88286]: WARNING cinder.quota [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1155603143 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1155603143, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:24:59 devstack cinder-volume[88286]: WARNING cinder.quota [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1155603143 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1155603143, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:24:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Created reservations ['21f3adbf-1c30-4da2-a969-656efe3a2cb6', 'f684b749-d664-4c06-9c57-5ef924f5d4e5', 'ec2b887a-2305-42f1-a536-af49bba0db5a', '6b086eef-8d68-43e9-a3d8-bd0bb2e1aa08'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:00 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:00 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:00 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.630s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:00 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-283f87a9-8119-47d6-88af-28119a0073ff tempest-GroupsV314Test-608632194 None] Delete group completed successfully. Jul 28 16:25:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Acquiring lock "cinder-quobyte-e820cb35-91a5-4289-829c-c034224f624d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-e820cb35-91a5-4289-829c-c034224f624d" acquired by "delete_volume" :: waited 0.071s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab411573-f741-40fa-b6d7-da5670e7d3d8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:01 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d Jul 28 16:25:01 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:02 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d" returned: 0 in 0.808s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:02 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d Jul 28 16:25:02 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:02 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e820cb35-91a5-4289-829c-c034224f624d" returned: 0 in 0.406s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Lock "cinder-quobyte-e820cb35-91a5-4289-829c-c034224f624d" released by "delete_volume" :: held 1.463s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:02 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Created reservations ['53d9bb7c-a668-4d83-b710-5423ac46a0c9'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Created reservations ['2df88dc5-42e4-4ee2-b5ad-3be3cdc15bc5', '123a73df-1bce-4ed1-9a85-90e3e73512b2', 'b5c9d67c-e204-438c-8001-fc0cf1042e8e', '2b8db829-b3ac-46c6-84fc-1aa9e24ba42a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:03 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:03 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:03 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:03 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a229f316-6b34-4fee-8009-5994942e895e tempest-GroupsV314Test-608632194 None] Delete group completed successfully. Jul 28 16:25:13 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=28,cinder:SELECT=18,cinder:INSERT=5 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:25:13 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=20,cinder:SELECT=18,cinder:INSERT=5 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Flow 'volume_create_manager' (0efa4aba-f943-42b5-99b7-0b2cb46d6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64db815c-0d91-40d4-aec5-84cb1a50d42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64db815c-0d91-40d4-aec5-84cb1a50d42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1934774457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e52c756-a963-488d-a8c4-402f713e9aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389dbd4960a4892a22a05cc657593a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:15Z,use_quota=True,user_id='0b257923b3df478fbec1bf1c00d2246c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe3f840-7c1d-4585-b8b0-4a78267f42a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe3f840-7c1d-4585-b8b0-4a78267f42a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8a28d1-1950-4c0c-bd00-919c8b4ac366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8a28d1-1950-4c0c-bd00-919c8b4ac366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e52c756-a963-488d-a8c4-402f713e9aa2', 'volume_name': 'volume-0e52c756-a963-488d-a8c4-402f713e9aa2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a71201-363c-4f70-8b3e-f8bf0a79f74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a71201-363c-4f70-8b3e-f8bf0a79f74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984b8dff-e42d-4ccf-94e6-1b9754c59959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:14 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Volume 0e52c756-a963-488d-a8c4-402f713e9aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e52c756-a963-488d-a8c4-402f713e9aa2', 'volume_size': 1} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1934774457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e52c756-a963-488d-a8c4-402f713e9aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389dbd4960a4892a22a05cc657593a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:15Z,use_quota=True,user_id='0b257923b3df478fbec1bf1c00d2246c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Creating volume 0e52c756-a963-488d-a8c4-402f713e9aa2 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:25:14 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:25:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:14 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 1073741824 Jul 28 16:25:15 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:16 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 1073741824" returned: 0 in 1.115s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:16 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 Jul 28 16:25:16 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:16 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2" returned: 0 in 0.349s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984b8dff-e42d-4ccf-94e6-1b9754c59959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e52c756-a963-488d-a8c4-402f713e9aa2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa17c7f-6d6f-460f-829a-b6cf407b4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:16 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Volume volume-0e52c756-a963-488d-a8c4-402f713e9aa2 (0e52c756-a963-488d-a8c4-402f713e9aa2): created successfully Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa17c7f-6d6f-460f-829a-b6cf407b4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Flow 'volume_create_manager' (0efa4aba-f943-42b5-99b7-0b2cb46d6b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:16 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ecfa988f-734d-4f8a-8344-5eb5bea12088 tempest-VolumeQuotasAdminTestJSON-1022070314 None] Created volume successfully. Jul 28 16:25:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Acquiring lock "cinder-0e52c756-a963-488d-a8c4-402f713e9aa2-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "cinder-0e52c756-a963-488d-a8c4-402f713e9aa2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Acquiring lock "cinder-quobyte-0e52c756-a963-488d-a8c4-402f713e9aa2" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "cinder-quobyte-0e52c756-a963-488d-a8c4-402f713e9aa2" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cc9ec9-8949-4d02-a381-c0a9570ab2be]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:17 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 Jul 28 16:25:17 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:18 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2" returned: 0 in 0.744s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:18 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2 Jul 28 16:25:18 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:18 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e52c756-a963-488d-a8c4-402f713e9aa2" returned: 0 in 0.376s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "cinder-quobyte-0e52c756-a963-488d-a8c4-402f713e9aa2" released by "delete_volume" :: held 1.213s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Created reservations ['68a9342e-9fa6-4913-b2e6-6cf994490c53', '4940bb9c-062f-490f-92e7-0a0f98c69f5e', '3169a54d-d936-4712-aede-bdbc328fa71e', '6fc7c191-c7d7-499d-a55d-f0ac20674319'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:18 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:18 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:18 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.257s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Deleted volume successfully. Jul 28 16:25:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ad9c51fb-381d-43b2-ac64-7f5333e2f5dc tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "cinder-0e52c756-a963-488d-a8c4-402f713e9aa2-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:19 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:25:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Flow 'volume_create_manager' (a56a3dff-c9cd-4edd-88bc-af0d962f0aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c903f19-86a6-4e7e-aa32-c09edd2c4c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c903f19-86a6-4e7e-aa32-c09edd2c4c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1363921581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ae7389-b904-49cb-ae84-3aedea15e297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389dbd4960a4892a22a05cc657593a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:20Z,use_quota=True,user_id='0b257923b3df478fbec1bf1c00d2246c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ef8280-36aa-4fd6-80fa-8306b5d15932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ef8280-36aa-4fd6-80fa-8306b5d15932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5bed30-ec33-4dab-b530-5031a5dc91cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5bed30-ec33-4dab-b530-5031a5dc91cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ae7389-b904-49cb-ae84-3aedea15e297', 'volume_name': 'volume-f4ae7389-b904-49cb-ae84-3aedea15e297', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c250697c-a630-4050-832c-5f5ffdd74b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c250697c-a630-4050-832c-5f5ffdd74b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922bb721-a974-4e06-9e9b-c167777844cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:20 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Volume f4ae7389-b904-49cb-ae84-3aedea15e297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ae7389-b904-49cb-ae84-3aedea15e297', 'volume_size': 1} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1363921581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ae7389-b904-49cb-ae84-3aedea15e297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389dbd4960a4892a22a05cc657593a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:20Z,use_quota=True,user_id='0b257923b3df478fbec1bf1c00d2246c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Creating volume f4ae7389-b904-49cb-ae84-3aedea15e297 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:25:20 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:20 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 1073741824 Jul 28 16:25:20 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:20 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 1073741824" returned: 0 in 0.457s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:20 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 Jul 28 16:25:20 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:20 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297" returned: 0 in 0.271s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922bb721-a974-4e06-9e9b-c167777844cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ae7389-b904-49cb-ae84-3aedea15e297', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826e9c26-7d80-4c12-bdda-36a3d9dc4405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:20 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Volume volume-f4ae7389-b904-49cb-ae84-3aedea15e297 (f4ae7389-b904-49cb-ae84-3aedea15e297): created successfully Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826e9c26-7d80-4c12-bdda-36a3d9dc4405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Flow 'volume_create_manager' (a56a3dff-c9cd-4edd-88bc-af0d962f0aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ce846f8d-e602-484f-93eb-1d67131e109b tempest-VolumeQuotasAdminTestJSON-1022070314 None] Created volume successfully. Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Flow 'volume_create_manager' (346e5aef-2239-428f-82ae-5a4a5cc3364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad45c30-ca2a-46e5-8417-1d2f88a97d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad45c30-ca2a-46e5-8417-1d2f88a97d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-76858085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cebd6d-1790-4268-9a22-0d951c4e1cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8e6888cd2741e39cef685266ed30a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:21Z,use_quota=True,user_id='5a780b8c2dba4d2a85160510b9c576ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f308eb-9823-41fd-9656-7ddca418fe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f308eb-9823-41fd-9656-7ddca418fe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bec4927-8135-4182-9cd0-567c227a3088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bec4927-8135-4182-9cd0-567c227a3088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cebd6d-1790-4268-9a22-0d951c4e1cc7', 'volume_name': 'volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099fcaa4-a35f-400c-8ac9-2b8065620ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099fcaa4-a35f-400c-8ac9-2b8065620ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9e72bf-491a-4eb3-b594-c8eed27ddb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:21 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Volume d4cebd6d-1790-4268-9a22-0d951c4e1cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7', 'volume_size': 1} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-76858085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cebd6d-1790-4268-9a22-0d951c4e1cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8e6888cd2741e39cef685266ed30a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:21Z,use_quota=True,user_id='5a780b8c2dba4d2a85160510b9c576ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Creating volume d4cebd6d-1790-4268-9a22-0d951c4e1cc7 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:25:21 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:21 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 1073741824 Jul 28 16:25:21 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:21 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 1073741824" returned: 0 in 0.518s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:21 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 Jul 28 16:25:21 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:22 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7" returned: 0 in 0.409s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:25:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9e72bf-491a-4eb3-b594-c8eed27ddb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8fab6e-64b0-44fc-8aae-e91430e1530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:22 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Volume volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 (d4cebd6d-1790-4268-9a22-0d951c4e1cc7): created successfully Jul 28 16:25:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8fab6e-64b0-44fc-8aae-e91430e1530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Flow 'volume_create_manager' (346e5aef-2239-428f-82ae-5a4a5cc3364d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4e33dd1d-f8dd-4515-8d2d-7b15ecba4283 tempest-ServersNegativeTestJSON-184723810 None] Created volume successfully. Jul 28 16:25:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-bab8c9c7-5484-4694-9b84-9365a9def877 tempest-VolumeQuotasAdminTestJSON-616014316 None] Transfer volume completed successfully. Jul 28 16:25:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Acquiring lock "cinder-f4ae7389-b904-49cb-ae84-3aedea15e297-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Lock "cinder-f4ae7389-b904-49cb-ae84-3aedea15e297-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Acquiring lock "cinder-quobyte-f4ae7389-b904-49cb-ae84-3aedea15e297" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Lock "cinder-quobyte-f4ae7389-b904-49cb-ae84-3aedea15e297" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e14161-539e-4251-9668-5fa2d6bdc489]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:23 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 Jul 28 16:25:23 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:24 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297" returned: 0 in 0.501s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:24 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297 Jul 28 16:25:24 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:24 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f4ae7389-b904-49cb-ae84-3aedea15e297" returned: 0 in 0.432s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Lock "cinder-quobyte-f4ae7389-b904-49cb-ae84-3aedea15e297" released by "delete_volume" :: held 0.993s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Created reservations ['693e0fa1-a40a-476d-a8e0-f92aee870590', '4f0fa217-1693-4bf9-af8f-5a03930bf31f', 'af05773b-e52f-4ed5-89ce-dd3ad734de4d', '10a397d7-cdf0-4a1a-95b3-ad173ef87917'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:24 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:24 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:24 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.321s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:24 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Deleted volume successfully. Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-35818c75-b030-4e92-8f61-905e11ea060a tempest-VolumeQuotasAdminTestJSON-1237213765 None] Lock "cinder-f4ae7389-b904-49cb-ae84-3aedea15e297-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Flow 'volume_create_manager' (48e88d07-9b9c-4309-a55b-ad76ccd2b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0167113-dfad-4436-bc6f-9d253b3780e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0167113-dfad-4436-bc6f-9d253b3780e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-425880050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98296c1-66e1-4174-a333-81d92e31687f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8e6888cd2741e39cef685266ed30a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:25Z,use_quota=True,user_id='5a780b8c2dba4d2a85160510b9c576ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c0e9b8-5ddc-47a4-8d7d-cf6c12fcefc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c0e9b8-5ddc-47a4-8d7d-cf6c12fcefc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ab6520-1481-479a-8568-bdf16beffedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ab6520-1481-479a-8568-bdf16beffedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98296c1-66e1-4174-a333-81d92e31687f', 'volume_name': 'volume-f98296c1-66e1-4174-a333-81d92e31687f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcdd1e1-2ed9-4fd2-b0a1-106f7dd921c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcdd1e1-2ed9-4fd2-b0a1-106f7dd921c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8ffd96-0daf-4a2d-969d-5d1cf1fdc0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:25 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Volume f98296c1-66e1-4174-a333-81d92e31687f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98296c1-66e1-4174-a333-81d92e31687f', 'volume_size': 1} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-425880050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98296c1-66e1-4174-a333-81d92e31687f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8e6888cd2741e39cef685266ed30a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:25Z,use_quota=True,user_id='5a780b8c2dba4d2a85160510b9c576ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Creating volume f98296c1-66e1-4174-a333-81d92e31687f {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:25:25 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:25 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f 1073741824 Jul 28 16:25:25 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:25 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f 1073741824" returned: 0 in 0.561s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:25 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f Jul 28 16:25:25 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:26 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f" returned: 0 in 0.372s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:25:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8ffd96-0daf-4a2d-969d-5d1cf1fdc0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98296c1-66e1-4174-a333-81d92e31687f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986fc6ff-9bb8-4f3d-b1e8-aab71567a523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:26 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Volume volume-f98296c1-66e1-4174-a333-81d92e31687f (f98296c1-66e1-4174-a333-81d92e31687f): created successfully Jul 28 16:25:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986fc6ff-9bb8-4f3d-b1e8-aab71567a523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Flow 'volume_create_manager' (48e88d07-9b9c-4309-a55b-ad76ccd2b67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-534084f4-9cf0-4201-ac9b-59d23b68f71d tempest-ServersNegativeTestJSON-184723810 None] Created volume successfully. Jul 28 16:25:27 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-f60f4e03-3840-402a-a95b-07737f9dea3e req-94c9d1c1-d173-4394-a86f-5380273bc2ef tempest-AttachVolumeNegativeTest-1156938776 None] Terminate volume connection completed successfully. Jul 28 16:25:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-f60f4e03-3840-402a-a95b-07737f9dea3e req-94c9d1c1-d173-4394-a86f-5380273bc2ef tempest-AttachVolumeNegativeTest-1156938776 None] Deleting attachment 2d793cf9-d595-4965-b4fb-4ec73ecad0c6. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:25:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "cinder-f98296c1-66e1-4174-a333-81d92e31687f-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-f98296c1-66e1-4174-a333-81d92e31687f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "cinder-quobyte-f98296c1-66e1-4174-a333-81d92e31687f" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-quobyte-f98296c1-66e1-4174-a333-81d92e31687f" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:27 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a45171-3dae-4388-b082-e3cba585bd4d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:28 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f Jul 28 16:25:28 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:28 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f" returned: 0 in 0.505s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:28 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f Jul 28 16:25:28 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:28 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f98296c1-66e1-4174-a333-81d92e31687f" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-quobyte-f98296c1-66e1-4174-a333-81d92e31687f" released by "delete_volume" :: held 0.893s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Created reservations ['c791c2f0-6843-4157-a534-25d2b1bd4364', 'c68bb3f6-cd3f-4080-8e47-8cbba5f5846a', '996ad641-9383-47d4-92f7-1b13788e9046', '667df97d-d8e4-40af-9a8e-34a5c4026c2f'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:29 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:29 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "cinder-d4cebd6d-1790-4268-9a22-0d951c4e1cc7-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-d4cebd6d-1790-4268-9a22-0d951c4e1cc7-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "cinder-quobyte-d4cebd6d-1790-4268-9a22-0d951c4e1cc7" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-quobyte-d4cebd6d-1790-4268-9a22-0d951c4e1cc7" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:29 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.431s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:29 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Deleted volume successfully. Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d7ba98-56b6-401f-8c82-16601408931c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e7836bcc-358d-4da8-96cb-35edd4d59367 tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-f98296c1-66e1-4174-a333-81d92e31687f-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:29 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 Jul 28 16:25:29 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:29 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:29 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7 Jul 28 16:25:29 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:30 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4cebd6d-1790-4268-9a22-0d951c4e1cc7" returned: 0 in 0.395s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-quobyte-d4cebd6d-1790-4268-9a22-0d951c4e1cc7" released by "delete_volume" :: held 0.937s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Created reservations ['66df514d-9725-41bb-8e74-527072727010', 'ab33a1dc-9771-44ca-9f44-7e7db18423d2', 'a210fa9e-4019-49fb-9ee0-cc2abd5e9ca6', 'ff91b3e6-959a-41a3-8289-0d5887687daf'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:30 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:30 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:30 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.406s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:31 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:31 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Deleted volume successfully. Jul 28 16:25:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b2643c91-5b0b-4d38-bbee-b0280adebfac tempest-ServersNegativeTestJSON-184723810 None] Lock "cinder-d4cebd6d-1790-4268-9a22-0d951c4e1cc7-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Flow 'volume_create_manager' (2895c378-0606-441d-a736-29f8cdbe256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081910a2-0429-44ed-aee2-9ef8dc16b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081910a2-0429-44ed-aee2-9ef8dc16b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1585651489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa38230-5bd4-42e1-bfb5-eff97ddfc019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e08034f725a4b1ca23d1f5f9b549a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:35Z,use_quota=True,user_id='575daf8273064a89af578278a4687207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d78d6b-b738-4ed2-bf6b-1557551ac48e),volume_type_id=a8d78d6b-b738-4ed2-bf6b-1557551ac48e)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e9ea06-5e01-41bb-8bd9-63e7217c5891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e9ea06-5e01-41bb-8bd9-63e7217c5891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40f9c80-0b28-4477-b2b8-94805de88608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40f9c80-0b28-4477-b2b8-94805de88608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa38230-5bd4-42e1-bfb5-eff97ddfc019', 'volume_name': 'volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6b1f47-de05-4c14-8502-8b56dd715fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6b1f47-de05-4c14-8502-8b56dd715fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c819881-0120-4bac-a606-ac49d36fbbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:35 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Volume 9fa38230-5bd4-42e1-bfb5-eff97ddfc019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019', 'volume_size': 1} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1585651489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa38230-5bd4-42e1-bfb5-eff97ddfc019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e08034f725a4b1ca23d1f5f9b549a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:35Z,use_quota=True,user_id='575daf8273064a89af578278a4687207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d78d6b-b738-4ed2-bf6b-1557551ac48e),volume_type_id=a8d78d6b-b738-4ed2-bf6b-1557551ac48e)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Creating volume 9fa38230-5bd4-42e1-bfb5-eff97ddfc019 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:25:35 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:25:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:35 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 1073741824 Jul 28 16:25:35 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:36 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 1073741824" returned: 0 in 0.590s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:36 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 Jul 28 16:25:36 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:36 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019" returned: 0 in 0.325s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c819881-0120-4bac-a606-ac49d36fbbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454cb868-86d9-446f-b3f7-f19c5080b102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:36 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Volume volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 (9fa38230-5bd4-42e1-bfb5-eff97ddfc019): created successfully Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454cb868-86d9-446f-b3f7-f19c5080b102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Flow 'volume_create_manager' (2895c378-0606-441d-a736-29f8cdbe256e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3beafd8c-0038-48a3-ad80-ee556e367355 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Created volume successfully. Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:38 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:38 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:38 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.296s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:38 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:38 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-975e349e-c6d8-4128-8e4b-51acb64c4295 tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Retype volume completed successfully. Jul 28 16:25:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Acquiring lock "cinder-9fa38230-5bd4-42e1-bfb5-eff97ddfc019-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "cinder-9fa38230-5bd4-42e1-bfb5-eff97ddfc019-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Acquiring lock "cinder-quobyte-9fa38230-5bd4-42e1-bfb5-eff97ddfc019" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "cinder-quobyte-9fa38230-5bd4-42e1-bfb5-eff97ddfc019" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6fcee6-a0a8-46ca-bca1-d61b18c2826b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:39 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 Jul 28 16:25:39 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:40 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019" returned: 0 in 0.448s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:40 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019 Jul 28 16:25:40 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:40 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9fa38230-5bd4-42e1-bfb5-eff97ddfc019" returned: 0 in 0.489s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "cinder-quobyte-9fa38230-5bd4-42e1-bfb5-eff97ddfc019" released by "delete_volume" :: held 1.007s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:40 devstack cinder-volume[88286]: WARNING cinder.quota [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:25:40 devstack cinder-volume[88286]: WARNING cinder.quota [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Created reservations ['25c3e72a-baa0-47f5-9152-be51ef43b8d4', '66649da2-4489-47d3-9c60-01f04e93ecfc', '1834b36b-72cb-4e5d-927b-33c55f4560f7', 'af6f4aca-0cea-43ab-b384-45fe4f18d0f2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:40 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:40 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:41 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.310s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:41 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Deleted volume successfully. Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:41 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:41 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12ebfef0-0056-4b79-a44f-0fe12cfd899c tempest-VolumeRetypeWithoutMigrationTest-194183038 None] Lock "cinder-9fa38230-5bd4-42e1-bfb5-eff97ddfc019-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:41 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.398s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:25:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Flow 'volume_create_manager' (16a75bd3-746a-4cda-aa44-35ee40da852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50a16dc-d832-4569-8953-142586a97952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50a16dc-d832-4569-8953-142586a97952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-770003751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4413942-16a8-423b-9b39-0c47fe8ed253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffea5613e564b7e9f6edc5fe731faa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:50Z,use_quota=True,user_id='a929f47c733e421fa4ec1f35f2ff9447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06330cfe-dc9c-4f27-b156-63ef17f47278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06330cfe-dc9c-4f27-b156-63ef17f47278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0c635e-7c3f-4f07-8463-41a3bb8a2ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0c635e-7c3f-4f07-8463-41a3bb8a2ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4413942-16a8-423b-9b39-0c47fe8ed253', 'volume_name': 'volume-d4413942-16a8-423b-9b39-0c47fe8ed253', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdecedf-18e8-4df7-a0e4-a65caf420b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdecedf-18e8-4df7-a0e4-a65caf420b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedb21e4-1b72-4d83-ac34-e05cc3433731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Volume d4413942-16a8-423b-9b39-0c47fe8ed253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4413942-16a8-423b-9b39-0c47fe8ed253', 'volume_size': 1} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-770003751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4413942-16a8-423b-9b39-0c47fe8ed253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffea5613e564b7e9f6edc5fe731faa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:50Z,use_quota=True,user_id='a929f47c733e421fa4ec1f35f2ff9447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Creating volume d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:25:50 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:25:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:50 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 1073741824 Jul 28 16:25:50 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:51 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 1073741824" returned: 0 in 0.519s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:51 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 Jul 28 16:25:51 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:51 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253" returned: 0 in 0.306s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedb21e4-1b72-4d83-ac34-e05cc3433731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4413942-16a8-423b-9b39-0c47fe8ed253', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00a2a24-3f7c-4b4f-bb98-226b4c3415fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:51 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Volume volume-d4413942-16a8-423b-9b39-0c47fe8ed253 (d4413942-16a8-423b-9b39-0c47fe8ed253): created successfully Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00a2a24-3f7c-4b4f-bb98-226b4c3415fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Flow 'volume_create_manager' (16a75bd3-746a-4cda-aa44-35ee40da852a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0f6ea46f-4bec-4be3-89a8-6263e78e7bb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Created volume successfully. Jul 28 16:25:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Creating offline snapshot db0134b3-fdf9-4841-ae12-a63202650314 of volume d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:25:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e5498-0276-450d-9f9c-42c77db68ad5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:53 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 Jul 28 16:25:53 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:53 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253" returned: 0 in 0.486s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:53 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 1G Jul 28 16:25:53 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:53 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 1G" returned: 0 in 0.444s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4413942-16a8-423b-9b39-0c47fe8ed253 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:53 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4413942-16a8-423b-9b39-0c47fe8ed253 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 Jul 28 16:25:53 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:54 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4413942-16a8-423b-9b39-0c47fe8ed253 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314" returned: 0 in 0.375s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:54 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 is being set with open permissions: ugo+rw Jul 28 16:25:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:54 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 Jul 28 16:25:54 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:54 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314" returned: 0 in 0.290s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:54 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.info Jul 28 16:25:54 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:54 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.info" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:54 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.info is being set with open permissions: ugo+rw Jul 28 16:25:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:54 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.info Jul 28 16:25:54 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:55 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.info" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6b6d546b-e183-4a11-be2e-399af16272c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Create snapshot completed successfully Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Flow 'volume_create_manager' (94317d92-99ac-4765-b95a-f0f6942855f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e152afb8-3457-4117-8814-0ebc807af651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e152afb8-3457-4117-8814-0ebc807af651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1283850960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e1a9e1-4228-446f-aa09-2656b367eaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac586978ef4401985eaae52e36723c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:56Z,use_quota=True,user_id='397e502a7be74353a8ddc0ceecba65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443f617c-892d-4e54-a08b-fdc7c36905df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443f617c-892d-4e54-a08b-fdc7c36905df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47c9f5c-98de-4754-93fb-d332b4a67230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47c9f5c-98de-4754-93fb-d332b4a67230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93e1a9e1-4228-446f-aa09-2656b367eaea', 'volume_name': 'volume-93e1a9e1-4228-446f-aa09-2656b367eaea', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8b29ab-61e3-4863-95e0-2a8afe555151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8b29ab-61e3-4863-95e0-2a8afe555151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4587930-d9ca-4635-98fe-003a041aed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:56 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Volume 93e1a9e1-4228-446f-aa09-2656b367eaea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93e1a9e1-4228-446f-aa09-2656b367eaea', 'volume_size': 1} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1283850960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e1a9e1-4228-446f-aa09-2656b367eaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac586978ef4401985eaae52e36723c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:25:56Z,use_quota=True,user_id='397e502a7be74353a8ddc0ceecba65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Creating volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:25:56 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:56 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea 1073741824 Jul 28 16:25:56 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "cinder-db0134b3-fdf9-4841-ae12-a63202650314-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-db0134b3-fdf9-4841-ae12-a63202650314-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "cinder-quobyte-d4413942-16a8-423b-9b39-0c47fe8ed253" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-quobyte-d4413942-16a8-423b-9b39-0c47fe8ed253" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "cinder-quobyte-db0134b3-fdf9-4841-ae12-a63202650314" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-quobyte-db0134b3-fdf9-4841-ae12-a63202650314" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Deleting offline snapshot db0134b3-fdf9-4841-ae12-a63202650314 of volume d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] snapshot_file for this snap is: volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ff4a9-5167-49ae-8ff0-624ecef1c627]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:56 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea 1073741824" returned: 0 in 0.547s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:56 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 Jul 28 16:25:56 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:56 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea Jul 28 16:25:56 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:57 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314" returned: 0 in 0.418s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4413942-16a8-423b-9b39-0c47fe8ed253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec59cea-9900-4d78-b5cd-4e461ebc64cc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:57 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea" returned: 0 in 0.299s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4587930-d9ca-4635-98fe-003a041aed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93e1a9e1-4228-446f-aa09-2656b367eaea', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634e4516-0f13-4c44-8e35-c98232ef32a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:25:57 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Volume volume-93e1a9e1-4228-446f-aa09-2656b367eaea (93e1a9e1-4228-446f-aa09-2656b367eaea): created successfully Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634e4516-0f13-4c44-8e35-c98232ef32a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Flow 'volume_create_manager' (94317d92-99ac-4765-b95a-f0f6942855f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:25:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9c3db23e-0a77-465d-821b-26c38191ef26 tempest-SnapshotsActionsTest-554501482 None] Created volume successfully. Jul 28 16:25:57 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 Jul 28 16:25:57 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:57 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253" returned: 0 in 0.409s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:57 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 Jul 28 16:25:57 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:57 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:57 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314 Jul 28 16:25:57 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:58 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253.db0134b3-fdf9-4841-ae12-a63202650314" returned: 0 in 0.275s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-quobyte-db0134b3-fdf9-4841-ae12-a63202650314" released by "_delete_snapshot" :: held 1.548s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-quobyte-d4413942-16a8-423b-9b39-0c47fe8ed253" released by "delete_snapshot" :: held 1.581s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:58 devstack cinder-volume[88286]: WARNING cinder.quota [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Created reservations ['eef506fb-0e4d-4986-a4d5-16e4980105b5', 'dc6a676f-522c-46dd-8527-988801b9411c', '46820b47-1117-40f4-8af4-3c9421c7d527', '56bfb294-1b28-4b3e-95d6-283568ecef09'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Delete snapshot completed successfully. Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ade4a0ae-b528-440b-8175-fc5e105e8e5d tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-db0134b3-fdf9-4841-ae12-a63202650314-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Creating offline snapshot cb7b646c-1d86-4eed-b713-484500d86a12 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0037f326-97dc-495f-b2c7-d64c6f66060e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:58 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea Jul 28 16:25:58 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "cinder-d4413942-16a8-423b-9b39-0c47fe8ed253-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-d4413942-16a8-423b-9b39-0c47fe8ed253-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "cinder-quobyte-d4413942-16a8-423b-9b39-0c47fe8ed253" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:25:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-quobyte-d4413942-16a8-423b-9b39-0c47fe8ed253" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0846b15-c432-4b97-970c-f666fc8650a6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:59 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea" returned: 0 in 0.447s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:59 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 1G Jul 28 16:25:59 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:59 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 Jul 28 16:25:59 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:59 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253" returned: 0 in 0.393s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:59 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253 Jul 28 16:25:59 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:59 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 1G" returned: 0 in 0.457s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:59 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:25:59 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:59 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d4413942-16a8-423b-9b39-0c47fe8ed253" returned: 0 in 0.300s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-quobyte-d4413942-16a8-423b-9b39-0c47fe8ed253" released by "delete_volume" :: held 0.765s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Created reservations ['de2b73b2-cd74-4112-97c4-eb2084930449', '45ede723-dfef-47ec-96a2-084530597ddf', '6c3bd165-b009-48b3-ada5-e2135286a87e', 'b059db21-f873-495a-bb31-0ab0ce1fdbde'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:25:59 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.362s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:25:59 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 is being set with open permissions: ugo+rw Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:59 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:25:59 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:25:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:25:59 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:25:59 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:00 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.286s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:00 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.298s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:26:00 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.info Jul 28 16:26:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Deleted volume successfully. Jul 28 16:26:00 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d909a85b-18e5-4885-8ce8-0a25ffa2ca16 tempest-VolumeSnapshotQuotasNegativeTestJSON-820051095 None] Lock "cinder-d4413942-16a8-423b-9b39-0c47fe8ed253-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:00 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.info" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:00 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.info is being set with open permissions: ugo+rw Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:00 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.info Jul 28 16:26:00 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:00 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.info" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d8d5dd0b-c235-4b39-9c79-ab08bd7cb8fe tempest-SnapshotsActionsTest-554501482 None] Create snapshot completed successfully Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Creating offline snapshot 1df3347b-cfb0-4d10-98d8-7d642122ec96 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d471edf-bc3a-47d4-8b8b-2dea2e2b0b53]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:02 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:02 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:02 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.390s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:02 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 1G Jul 28 16:26:02 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:03 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 1G" returned: 0 in 0.526s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:03 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 Jul 28 16:26:03 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:03 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:03 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 is being set with open permissions: ugo+rw Jul 28 16:26:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:03 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 Jul 28 16:26:03 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:03 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96" returned: 0 in 0.248s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.604s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:04 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e3c9113e-bbc8-4449-b28f-fc128b925bde tempest-SnapshotsActionsTest-554501482 None] Create snapshot completed successfully Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-1df3347b-cfb0-4d10-98d8-7d642122ec96-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-1df3347b-cfb0-4d10-98d8-7d642122ec96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-1df3347b-cfb0-4d10-98d8-7d642122ec96" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-1df3347b-cfb0-4d10-98d8-7d642122ec96" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Deleting offline snapshot 1df3347b-cfb0-4d10-98d8-7d642122ec96 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] snapshot_file for this snap is: volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b57bb5-6e4d-4f0a-86db-54918520b7fe]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:04 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 Jul 28 16:26:04 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:05 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96" returned: 0 in 0.493s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6f2d61-876e-4106-9b7d-6e1bbf6a55f9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:05 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:05 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:05 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.482s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:05 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 Jul 28 16:26:05 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:06 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:06 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96 Jul 28 16:26:06 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:06 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.1df3347b-cfb0-4d10-98d8-7d642122ec96" returned: 0 in 0.278s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-1df3347b-cfb0-4d10-98d8-7d642122ec96" released by "_delete_snapshot" :: held 1.862s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" released by "delete_snapshot" :: held 1.893s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:06 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Created reservations ['2244234a-513b-4b6f-93f2-6528d7244316', 'bffdd1a4-3bdc-430a-99d3-a4a292618826', '35b85689-a7ae-4992-9e28-f721b1a9c38e', '918dac07-5801-4e84-94bf-e4f4a54cefe0'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:06 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Delete snapshot completed successfully. Jul 28 16:26:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e1ead7e7-98c2-4307-beb6-8d00315348b9 tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-1df3347b-cfb0-4d10-98d8-7d642122ec96-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Creating offline snapshot b734ebd8-f412-4fa2-a29a-1f21337c2851 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b565240-f25b-46db-b36e-11e7a0bd5155]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:07 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:07 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:07 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.384s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:07 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 1G Jul 28 16:26:07 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:08 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 1G" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:08 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 Jul 28 16:26:08 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:08 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851" returned: 0 in 0.355s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:08 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 is being set with open permissions: ugo+rw Jul 28 16:26:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:08 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 Jul 28 16:26:08 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:08 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851" returned: 0 in 0.252s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.585s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-48b178a8-bbc1-4816-bffa-b13676ada812 tempest-SnapshotsActionsTest-554501482 None] Create snapshot completed successfully Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-b734ebd8-f412-4fa2-a29a-1f21337c2851-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-b734ebd8-f412-4fa2-a29a-1f21337c2851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-b734ebd8-f412-4fa2-a29a-1f21337c2851" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-b734ebd8-f412-4fa2-a29a-1f21337c2851" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Deleting offline snapshot b734ebd8-f412-4fa2-a29a-1f21337c2851 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] snapshot_file for this snap is: volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a67be4-d692-4f3c-b070-64bf6a1d9831]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:09 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 Jul 28 16:26:09 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Flow 'volume_create_manager' (1456b063-13d0-453b-b6e6-575b27153977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33973a9-3fb1-478e-a17a-e06861573d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33973a9-3fb1-478e-a17a-e06861573d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1332621212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c55329-0cf5-439b-9cb0-55e983dd8a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f72a89474434d5494b5e4275aaa32ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:10Z,use_quota=True,user_id='a09aa0ee14d64675a32ddfa5a46fce5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8126fd3f-e34f-458d-a204-7dbce6d1f1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8126fd3f-e34f-458d-a204-7dbce6d1f1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475beb95-a648-499d-9aab-bc7915f13358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475beb95-a648-499d-9aab-bc7915f13358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c55329-0cf5-439b-9cb0-55e983dd8a21', 'volume_name': 'volume-00c55329-0cf5-439b-9cb0-55e983dd8a21', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8969bbb1-5c16-4eb4-8f8b-8e9b5f1245d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8969bbb1-5c16-4eb4-8f8b-8e9b5f1245d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ddabec-0711-4fef-8074-873c45421ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Volume 00c55329-0cf5-439b-9cb0-55e983dd8a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c55329-0cf5-439b-9cb0-55e983dd8a21', 'volume_size': 1} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1332621212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c55329-0cf5-439b-9cb0-55e983dd8a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f72a89474434d5494b5e4275aaa32ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:10Z,use_quota=True,user_id='a09aa0ee14d64675a32ddfa5a46fce5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Creating volume 00c55329-0cf5-439b-9cb0-55e983dd8a21 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:10 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:26:10 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851" returned: 0 in 0.597s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:10 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 1073741824 Jul 28 16:26:10 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb90c0b-5763-43b0-aa3a-ff2860a0a559]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:10 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:10 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:10 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.464s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:10 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 1073741824" returned: 0 in 0.556s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:10 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 Jul 28 16:26:10 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:10 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 Jul 28 16:26:10 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:11 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21" returned: 0 in 0.321s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ddabec-0711-4fef-8074-873c45421ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c55329-0cf5-439b-9cb0-55e983dd8a21', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5257ddbc-6e78-4556-863e-1dc9655b918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:11 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Volume volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 (00c55329-0cf5-439b-9cb0-55e983dd8a21): created successfully Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5257ddbc-6e78-4556-863e-1dc9655b918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Flow 'volume_create_manager' (1456b063-13d0-453b-b6e6-575b27153977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6fdbe3a1-83ab-4f5c-8fc5-fc89c4b1d41e tempest-AttachVolumeNegativeTest-1156938776 None] Created volume successfully. Jul 28 16:26:11 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851" returned: 0 in 0.488s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:11 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851 Jul 28 16:26:11 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:11 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.b734ebd8-f412-4fa2-a29a-1f21337c2851" returned: 0 in 0.264s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-b734ebd8-f412-4fa2-a29a-1f21337c2851" released by "_delete_snapshot" :: held 1.981s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" released by "delete_snapshot" :: held 2.020s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Created reservations ['27ceed37-360b-4faa-ad43-2db74f9aec2d', 'fa3defb3-e34e-4415-97eb-8ac5eb60be14', 'f574e0e6-a928-44c3-82ed-68882f16d283', '58c46645-e385-4bc1-87e2-33ff6e542596'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Delete snapshot completed successfully. Jul 28 16:26:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1d25c1c5-f428-4718-805b-2346d5e2eebb tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-b734ebd8-f412-4fa2-a29a-1f21337c2851-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Creating offline snapshot f58ae974-8f43-463a-a6a1-04394eed20cd of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e3fdba-82c3-4353-8847-79212222eeff]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=87,cinder:INSERT=22,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=107,cinder:SELECT=79,cinder:DELETE=12,cinder:INSERT=24 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-22c848e2-66d0-4bca-89cc-94cc05275cb4 req-7b439abe-42d9-4188-be6d-6fa245baadd8 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:13 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:13 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:13 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.408s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:13 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd 1G Jul 28 16:26:13 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:14 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd 1G" returned: 0 in 0.554s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:14 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd Jul 28 16:26:14 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:14 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd" returned: 0 in 0.339s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:14 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd is being set with open permissions: ugo+rw Jul 28 16:26:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:14 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd Jul 28 16:26:14 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:14 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd" returned: 0 in 0.323s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.759s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-22c848e2-66d0-4bca-89cc-94cc05275cb4 req-7b439abe-42d9-4188-be6d-6fa245baadd8 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.564s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-22c848e2-66d0-4bca-89cc-94cc05275cb4 req-7b439abe-42d9-4188-be6d-6fa245baadd8 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e91f6c8d-bcdf-4e8c-8483-7e543b7e29b6 tempest-SnapshotsActionsTest-554501482 None] Create snapshot completed successfully Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-22c848e2-66d0-4bca-89cc-94cc05275cb4 req-7b439abe-42d9-4188-be6d-6fa245baadd8 tempest-AttachVolumeNegativeTest-1156938776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-00c55329-0cf5-439b-9cb0-55e983dd8a21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c1ac94e-f5ae-435b-bd05-d635d1b49720', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:26:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-22c848e2-66d0-4bca-89cc-94cc05275cb4 req-7b439abe-42d9-4188-be6d-6fa245baadd8 tempest-AttachVolumeNegativeTest-1156938776 None] attachment_update completed successfully. Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-f58ae974-8f43-463a-a6a1-04394eed20cd-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-f58ae974-8f43-463a-a6a1-04394eed20cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-f58ae974-8f43-463a-a6a1-04394eed20cd" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-f58ae974-8f43-463a-a6a1-04394eed20cd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Deleting offline snapshot f58ae974-8f43-463a-a6a1-04394eed20cd of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] snapshot_file for this snap is: volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56fbc4-c12a-45ba-9b26-9649aa6bc9c1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:15 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd Jul 28 16:26:15 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:16 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd" returned: 0 in 0.569s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:16 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea41515-e7df-4015-9f62-048734902eff]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:16 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:16 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:16 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.426s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:16 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd Jul 28 16:26:16 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:17 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd" returned: 0 in 0.453s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:17 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd Jul 28 16:26:17 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:17 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.f58ae974-8f43-463a-a6a1-04394eed20cd" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-f58ae974-8f43-463a-a6a1-04394eed20cd" released by "_delete_snapshot" :: held 1.959s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" released by "delete_snapshot" :: held 1.999s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:17 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Created reservations ['64029eee-9d0a-4a39-8285-dd6c68847880', '1c45b4f0-72d3-40ea-923f-385d1b7a735b', '88651aa6-f792-4809-a133-8468ded4c781', '7ad4c9d2-08ad-436f-a8a1-a4acbec90812'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Delete snapshot completed successfully. Jul 28 16:26:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e58250d0-fef6-4a9e-9423-b3065982100a tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-f58ae974-8f43-463a-a6a1-04394eed20cd-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-503b399c-7f01-4c5c-b73e-032d7766a161 req-54df4067-302a-4ad9-9173-800bff9866e1 tempest-AttachVolumeNegativeTest-1156938776 None] Terminate volume connection completed successfully. Jul 28 16:26:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-503b399c-7f01-4c5c-b73e-032d7766a161 req-54df4067-302a-4ad9-9173-800bff9866e1 tempest-AttachVolumeNegativeTest-1156938776 None] Deleting attachment 5c1ac94e-f5ae-435b-bd05-d635d1b49720. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Creating offline snapshot 562f2014-a4d8-48d2-9f82-b1367ba27251 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff72f1-5076-44c7-b63d-ab4bfa2c84a5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:19 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:19 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:19 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.500s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:19 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 1G Jul 28 16:26:19 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:20 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 1G" returned: 0 in 0.720s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:20 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 Jul 28 16:26:20 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:20 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251" returned: 0 in 0.447s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:20 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 is being set with open permissions: ugo+rw Jul 28 16:26:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:20 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 Jul 28 16:26:20 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:21 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251" returned: 0 in 0.347s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2f2e34a0-5f33-43b9-985d-7051ebadda84 tempest-SnapshotsActionsTest-554501482 None] Create snapshot completed successfully Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-562f2014-a4d8-48d2-9f82-b1367ba27251-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-562f2014-a4d8-48d2-9f82-b1367ba27251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Acquiring lock "cinder-quobyte-562f2014-a4d8-48d2-9f82-b1367ba27251" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-562f2014-a4d8-48d2-9f82-b1367ba27251" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Deleting offline snapshot 562f2014-a4d8-48d2-9f82-b1367ba27251 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] snapshot_file for this snap is: volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de02590-8678-4a2d-b5d3-1427d393cf3a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:22 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 Jul 28 16:26:22 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:23 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251" returned: 0 in 0.518s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d92a437-d8a4-408a-a6b7-a72079f55b5c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:23 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:23 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:23 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.448s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:23 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 Jul 28 16:26:23 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:24 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251" returned: 0 in 0.551s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:24 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251 Jul 28 16:26:24 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:24 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.562f2014-a4d8-48d2-9f82-b1367ba27251" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-562f2014-a4d8-48d2-9f82-b1367ba27251" released by "_delete_snapshot" :: held 1.969s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" released by "delete_snapshot" :: held 1.998s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:24 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Created reservations ['2354e493-8ade-44c1-a1a6-54e16a0e93fd', '42c9dc6d-c315-4d18-9db8-3fbc3d649de6', '5c041ccb-cf1c-4c14-85fb-02fb77c4ab0d', 'ecf7d54c-3c62-4010-bb0f-7e6b9529e185'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Delete snapshot completed successfully. Jul 28 16:26:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7569074d-eba6-4c14-b99c-08b32d1df60d tempest-SnapshotsActionsTest-1187975620 None] Lock "cinder-562f2014-a4d8-48d2-9f82-b1367ba27251-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "cinder-cb7b646c-1d86-4eed-b713-484500d86a12-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-cb7b646c-1d86-4eed-b713-484500d86a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "cinder-quobyte-cb7b646c-1d86-4eed-b713-484500d86a12" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-quobyte-cb7b646c-1d86-4eed-b713-484500d86a12" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Deleting offline snapshot cb7b646c-1d86-4eed-b713-484500d86a12 of volume 93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] snapshot_file for this snap is: volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3833847-c03f-49be-ba4b-3c5cefe3b1c5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:26 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:26 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:26 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.456s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93e1a9e1-4228-446f-aa09-2656b367eaea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e59d08b-2bfd-455e-a683-1f4e710c996c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:27 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea Jul 28 16:26:27 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:27 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea" returned: 0 in 0.587s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:27 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:27 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:28 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:28 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12 Jul 28 16:26:28 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:28 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea.cb7b646c-1d86-4eed-b713-484500d86a12" returned: 0 in 0.293s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-quobyte-cb7b646c-1d86-4eed-b713-484500d86a12" released by "_delete_snapshot" :: held 1.960s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" released by "delete_snapshot" :: held 1.998s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:28 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Created reservations ['0c834981-cc4b-4b36-b8ac-647ad54ed29a', 'd84b6fce-cd2f-44c5-955a-2073bf6accb4', '3d61a4bb-7b63-4eea-9f22-fcbc63aaef1d', 'fe9b8990-5ed0-4e00-90af-b99eb8d65cb7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Delete snapshot completed successfully. Jul 28 16:26:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16d12a96-d6cc-49ca-8e4a-b867b95c750e tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-cb7b646c-1d86-4eed-b713-484500d86a12-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "cinder-93e1a9e1-4228-446f-aa09-2656b367eaea-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-93e1a9e1-4228-446f-aa09-2656b367eaea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef2d208-0295-4d3a-b280-45779d9d9509]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:30 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea Jul 28 16:26:30 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:30 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea" returned: 0 in 0.521s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:30 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea Jul 28 16:26:30 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:30 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-93e1a9e1-4228-446f-aa09-2656b367eaea" returned: 0 in 0.284s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-quobyte-93e1a9e1-4228-446f-aa09-2656b367eaea" released by "delete_volume" :: held 0.894s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Created reservations ['988dfa74-63a5-4092-b57e-9b3336536bcd', '395fcc43-c3e2-4451-85c7-93d7eec95b36', 'ab6eefaf-8821-47c7-9f18-584edfeb98db', '10b14662-168c-42cf-b1ef-8c069c15b626'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:30 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:26:30 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:31 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.380s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:31 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:26:31 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Deleted volume successfully. Jul 28 16:26:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-820f43be-8e6d-4e1b-8969-4f2bfdb187ce tempest-SnapshotsActionsTest-554501482 None] Lock "cinder-93e1a9e1-4228-446f-aa09-2656b367eaea-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:40 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=6 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:41 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:26:41 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=32,cinder:DELETE=3,cinder:UPDATE=23,cinder:INSERT=10 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:26:41 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.700s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:26:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (e9266ce4-5892-4216-bfe6-4116dc3b5e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695e93fa-bdac-4c79-8002-5ef58b14a8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695e93fa-bdac-4c79-8002-5ef58b14a8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1712937030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e420fc8-7556-42a1-820f-86ae13d1122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:45Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19b47e-2a8c-4d8f-a2be-e8d2f7f043d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19b47e-2a8c-4d8f-a2be-e8d2f7f043d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a174485-5f44-49b4-a2ce-e238a0b39c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a174485-5f44-49b4-a2ce-e238a0b39c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e420fc8-7556-42a1-820f-86ae13d1122a', 'volume_name': 'volume-7e420fc8-7556-42a1-820f-86ae13d1122a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426a656b-052d-45aa-a833-ee435dc5ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426a656b-052d-45aa-a833-ee435dc5ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596faf9d-e6d7-47f5-9be3-7f722f349c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Volume 7e420fc8-7556-42a1-820f-86ae13d1122a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e420fc8-7556-42a1-820f-86ae13d1122a', 'volume_size': 1} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1712937030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e420fc8-7556-42a1-820f-86ae13d1122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:45Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Creating volume 7e420fc8-7556-42a1-820f-86ae13d1122a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:26:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:26:44 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a 1073741824 Jul 28 16:26:44 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Flow 'volume_create_manager' (f008d562-b3eb-440a-a519-0688004d95f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06105678-c0ec-4c16-abe2-0f612e0bf6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06105678-c0ec-4c16-abe2-0f612e0bf6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1507436537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce53076-cabc-40cf-a6f8-4a0c33ff0116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19abf2fab6274a7b9b8aa0de53f7b674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:45Z,use_quota=True,user_id='34d6be853dc342d49b45f9a844496418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899a1a21-0134-47dc-89ba-3b90db89d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899a1a21-0134-47dc-89ba-3b90db89d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb235994-90d0-4ed5-8b13-e9c4137cbc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb235994-90d0-4ed5-8b13-e9c4137cbc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce53076-cabc-40cf-a6f8-4a0c33ff0116', 'volume_name': 'volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c0cb3d-dee4-4b90-ad8d-978c8cb00cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c0cb3d-dee4-4b90-ad8d-978c8cb00cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c812e946-579d-40d3-95f6-f6c500787fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Volume 6ce53076-cabc-40cf-a6f8-4a0c33ff0116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116', 'volume_size': 1} Jul 28 16:26:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:45 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a 1073741824" returned: 0 in 0.637s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:45 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a Jul 28 16:26:45 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:45 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1507436537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce53076-cabc-40cf-a6f8-4a0c33ff0116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19abf2fab6274a7b9b8aa0de53f7b674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:45Z,use_quota=True,user_id='34d6be853dc342d49b45f9a844496418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Creating volume 6ce53076-cabc-40cf-a6f8-4a0c33ff0116 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:26:45 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:45 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 1073741824 Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596faf9d-e6d7-47f5-9be3-7f722f349c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e420fc8-7556-42a1-820f-86ae13d1122a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:45 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5522dbb4-a2f2-448b-9719-84ee1fc56351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Volume volume-7e420fc8-7556-42a1-820f-86ae13d1122a (7e420fc8-7556-42a1-820f-86ae13d1122a): created successfully Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5522dbb4-a2f2-448b-9719-84ee1fc56351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (e9266ce4-5892-4216-bfe6-4116dc3b5e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c34ed312-4d21-47e8-a3fb-c200365c8e9a tempest-VolumesActionsTest-669507295 None] Created volume successfully. Jul 28 16:26:46 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 1073741824" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:46 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 Jul 28 16:26:46 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-41d46db3-328b-42d0-a56d-c33f5631fec1 tempest-VolumesActionsTest-669507295 None] Acquiring lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a" by "attach_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-41d46db3-328b-42d0-a56d-c33f5631fec1 tempest-VolumesActionsTest-669507295 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a" acquired by "attach_volume" :: waited 0.051s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:46 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116" returned: 0 in 0.383s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c812e946-579d-40d3-95f6-f6c500787fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f483f-8c38-422e-9110-e81f43fe1461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Volume volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 (6ce53076-cabc-40cf-a6f8-4a0c33ff0116): created successfully Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f483f-8c38-422e-9110-e81f43fe1461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Flow 'volume_create_manager' (f008d562-b3eb-440a-a519-0688004d95f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-41d46db3-328b-42d0-a56d-c33f5631fec1 tempest-VolumesActionsTest-669507295 None] Attaching volume 7e420fc8-7556-42a1-820f-86ae13d1122a to instance a855a6d8-8849-4e4f-aa22-b14331a9e070 at mountpoint /dev/vdb on host None. Jul 28 16:26:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5a75888a-8909-4f6a-b5ac-8ca8acc97887 tempest-VolumesServicesTestJSON-1360161548 None] Created volume successfully. Jul 28 16:26:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-41d46db3-328b-42d0-a56d-c33f5631fec1 tempest-VolumesActionsTest-669507295 None] Attach volume completed successfully. Jul 28 16:26:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-41d46db3-328b-42d0-a56d-c33f5631fec1 tempest-VolumesActionsTest-669507295 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a" released by "attach_volume" :: held 0.191s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5e90ecaf-0983-4b81-a043-c4dae33e04b2 tempest-VolumesActionsTest-495160572 None] Terminate volume connection completed successfully. Jul 28 16:26:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e90ecaf-0983-4b81-a043-c4dae33e04b2 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-detach_volume" by "detach_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e90ecaf-0983-4b81-a043-c4dae33e04b2 tempest-VolumesActionsTest-495160572 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5e90ecaf-0983-4b81-a043-c4dae33e04b2 tempest-VolumesActionsTest-495160572 None] Detaching volume 7e420fc8-7556-42a1-820f-86ae13d1122a from instance a855a6d8-8849-4e4f-aa22-b14331a9e070. Jul 28 16:26:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5e90ecaf-0983-4b81-a043-c4dae33e04b2 tempest-VolumesActionsTest-495160572 None] Detach volume completed successfully. Jul 28 16:26:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e90ecaf-0983-4b81-a043-c4dae33e04b2 tempest-VolumesActionsTest-495160572 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-62996e76-69d6-40b1-a801-0bb9b2545f6c tempest-VolumesActionsTest-669507295 None] Acquiring lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-detach_volume" by "detach_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-62996e76-69d6-40b1-a801-0bb9b2545f6c tempest-VolumesActionsTest-669507295 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-62996e76-69d6-40b1-a801-0bb9b2545f6c tempest-VolumesActionsTest-669507295 None] Volume detach called, but volume not attached. Jul 28 16:26:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-62996e76-69d6-40b1-a801-0bb9b2545f6c tempest-VolumesActionsTest-669507295 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Acquiring lock "cinder-6ce53076-cabc-40cf-a6f8-4a0c33ff0116-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Lock "cinder-6ce53076-cabc-40cf-a6f8-4a0c33ff0116-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Acquiring lock "cinder-quobyte-6ce53076-cabc-40cf-a6f8-4a0c33ff0116" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Lock "cinder-quobyte-6ce53076-cabc-40cf-a6f8-4a0c33ff0116" acquired by "delete_volume" :: waited 0.053s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Acquiring lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401cf77-d7de-48a3-a89e-04939dde2bf6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Acquiring lock "cinder-quobyte-7e420fc8-7556-42a1-820f-86ae13d1122a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Lock "cinder-quobyte-7e420fc8-7556-42a1-820f-86ae13d1122a" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44b4351-2fb1-4a5f-a4ab-7708945abbd2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:48 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 Jul 28 16:26:48 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:48 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a Jul 28 16:26:48 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:48 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116" returned: 0 in 0.499s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:48 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116 Jul 28 16:26:48 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:48 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a" returned: 0 in 0.604s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:49 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ce53076-cabc-40cf-a6f8-4a0c33ff0116" returned: 0 in 0.301s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:49 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a Jul 28 16:26:49 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Lock "cinder-quobyte-6ce53076-cabc-40cf-a6f8-4a0c33ff0116" released by "delete_volume" :: held 0.897s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Created reservations ['022b8b40-0314-4e18-a357-3ee72d4b0732', '5290c863-c994-4958-98b7-16e5b690c176', 'e09668bc-5dda-467a-9a03-b34b5b2b9c9e', '6e295e7d-c803-479e-a7d6-6a9410b3f19d'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:49 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:26:49 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:49 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e420fc8-7556-42a1-820f-86ae13d1122a" returned: 0 in 0.425s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Lock "cinder-quobyte-7e420fc8-7556-42a1-820f-86ae13d1122a" released by "delete_volume" :: held 1.095s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Created reservations ['4183ea21-398f-46aa-974a-e6450a1e3f7c', '4e3f7b3e-fbae-497a-8521-715d0f54ebd7', 'db105e44-6a02-42df-99e3-4fc15e200eb3', '9fe3a3a9-764d-48e0-b484-5516bca39eaa'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:49 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:26:49 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:49 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:26:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Deleted volume successfully. Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6328c9-1d48-4c19-8ac7-f04b3c7e992b tempest-VolumesServicesTestJSON-1360161548 None] Lock "cinder-6ce53076-cabc-40cf-a6f8-4a0c33ff0116-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:49 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.300s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:26:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Deleted volume successfully. Jul 28 16:26:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f8db2401-a3e0-4833-872d-a02135335755 tempest-VolumesActionsTest-669507295 None] Lock "cinder-7e420fc8-7556-42a1-820f-86ae13d1122a-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (c15fe0ee-19d2-44ed-b46b-3bf45a90330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c497931c-45c7-4815-a185-ece9c8f84973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c497931c-45c7-4815-a185-ece9c8f84973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-542315887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063e4699-e069-41b4-b9ea-1915bc2593e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:56Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d62bd3-ebc0-47fd-8997-e2b747094872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d62bd3-ebc0-47fd-8997-e2b747094872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3299d161-ed89-4bb0-90cb-659ccf4448c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3299d161-ed89-4bb0-90cb-659ccf4448c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063e4699-e069-41b4-b9ea-1915bc2593e6', 'volume_name': 'volume-063e4699-e069-41b4-b9ea-1915bc2593e6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660f1b3-5e06-4974-95de-5aa28ca2e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660f1b3-5e06-4974-95de-5aa28ca2e090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1a4e29-0a2c-4ef6-9a1a-bfb3ba2a534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:55 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Volume 063e4699-e069-41b4-b9ea-1915bc2593e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063e4699-e069-41b4-b9ea-1915bc2593e6', 'volume_size': 1} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-542315887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063e4699-e069-41b4-b9ea-1915bc2593e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:26:56Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Creating volume 063e4699-e069-41b4-b9ea-1915bc2593e6 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:26:55 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:26:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:55 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 1073741824 Jul 28 16:26:55 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:56 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 1073741824" returned: 0 in 0.474s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:56 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 Jul 28 16:26:56 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:56 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1a4e29-0a2c-4ef6-9a1a-bfb3ba2a534e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063e4699-e069-41b4-b9ea-1915bc2593e6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab957673-f1a3-4ed0-a6e3-56095aedd477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:26:56 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Volume volume-063e4699-e069-41b4-b9ea-1915bc2593e6 (063e4699-e069-41b4-b9ea-1915bc2593e6): created successfully Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab957673-f1a3-4ed0-a6e3-56095aedd477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:26:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (c15fe0ee-19d2-44ed-b46b-3bf45a90330c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:26:56 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b6b86294-79b6-46a8-b7b9-c7374956b3ea tempest-VolumesActionsTest-669507295 None] Created volume successfully. Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-063e4699-e069-41b4-b9ea-1915bc2593e6-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-063e4699-e069-41b4-b9ea-1915bc2593e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-quobyte-063e4699-e069-41b4-b9ea-1915bc2593e6" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-063e4699-e069-41b4-b9ea-1915bc2593e6" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9eedf-801d-4896-84c9-9173cb43f0ad]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:58 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 Jul 28 16:26:58 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:58 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6" returned: 0 in 0.419s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:58 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6 Jul 28 16:26:58 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:59 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-063e4699-e069-41b4-b9ea-1915bc2593e6" returned: 0 in 0.302s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-063e4699-e069-41b4-b9ea-1915bc2593e6" released by "delete_volume" :: held 0.767s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Created reservations ['3884b52e-3bff-4eb3-8a6a-6fc52c97bf61', '2f51a47f-7035-4cc0-a2f2-673c75106a9b', '00d4f848-b2a7-4187-8b9b-00427315b386', '30251707-23e5-4730-80c1-2409dde6a95c'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:26:59 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:26:59 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:26:59 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.345s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:26:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Deleted volume successfully. Jul 28 16:26:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cc016670-019b-44c5-888e-223525272be9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-063e4699-e069-41b4-b9ea-1915bc2593e6-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (703db74c-81fc-4138-b9b2-c887c3ff0c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2127b8-611d-4cfe-8790-9da3a755cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2127b8-611d-4cfe-8790-9da3a755cae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-838796372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0d2307-16fd-47ed-88d3-464041d0f426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:00Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f03cab-c046-455f-b109-15f210d8c75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f03cab-c046-455f-b109-15f210d8c75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea9ba9c-d058-458d-ad44-14c9dab3511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea9ba9c-d058-458d-ad44-14c9dab3511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0d2307-16fd-47ed-88d3-464041d0f426', 'volume_name': 'volume-0b0d2307-16fd-47ed-88d3-464041d0f426', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d84f367-e716-48d5-abd0-77710e53a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d84f367-e716-48d5-abd0-77710e53a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22144721-9dde-425b-8c48-9193a7da91b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:00 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Volume 0b0d2307-16fd-47ed-88d3-464041d0f426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0d2307-16fd-47ed-88d3-464041d0f426', 'volume_size': 1} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-838796372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0d2307-16fd-47ed-88d3-464041d0f426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:00Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Creating volume 0b0d2307-16fd-47ed-88d3-464041d0f426 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:00 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:00 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 1073741824 Jul 28 16:27:00 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:01 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 1073741824" returned: 0 in 0.661s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:01 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 Jul 28 16:27:01 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:01 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22144721-9dde-425b-8c48-9193a7da91b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0d2307-16fd-47ed-88d3-464041d0f426', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdfb682-2ebe-4112-a2b1-7e6892555f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Volume volume-0b0d2307-16fd-47ed-88d3-464041d0f426 (0b0d2307-16fd-47ed-88d3-464041d0f426): created successfully Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdfb682-2ebe-4112-a2b1-7e6892555f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (703db74c-81fc-4138-b9b2-c887c3ff0c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-60d9152d-fd0c-4119-8f46-fb78a84f83f9 tempest-VolumesActionsTest-669507295 None] Created volume successfully. Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-0b0d2307-16fd-47ed-88d3-464041d0f426-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Lock "cinder-0b0d2307-16fd-47ed-88d3-464041d0f426-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-quobyte-0b0d2307-16fd-47ed-88d3-464041d0f426" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-0b0d2307-16fd-47ed-88d3-464041d0f426" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fde5f0-23ce-40bc-ab73-4c69805364a3]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:02 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 Jul 28 16:27:02 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:02 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426" returned: 0 in 0.389s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:02 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426 Jul 28 16:27:02 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:03 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0b0d2307-16fd-47ed-88d3-464041d0f426" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-0b0d2307-16fd-47ed-88d3-464041d0f426" released by "delete_volume" :: held 0.746s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Created reservations ['b4e11631-a450-40a6-9350-a37cb933cbe1', '1726f622-8d81-470a-bff4-d86a04ccbf38', '70b0e0d2-5718-482e-9736-503e873b8120', 'ca2f234e-4f94-4bf9-9f30-7a3ada454fd0'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:03 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:03 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:03 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.313s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Deleted volume successfully. Jul 28 16:27:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4b7025b-ea7a-4145-9477-61f9fecdae39 tempest-VolumesActionsTest-495160572 None] Lock "cinder-0b0d2307-16fd-47ed-88d3-464041d0f426-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Flow 'volume_create_manager' (1d49a623-5ade-4055-b0c5-ff1821629381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2159521-3d35-4837-b5fc-763d051af2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2159521-3d35-4837-b5fc-763d051af2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1279054490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20ce828-a5de-4b06-b570-ccbd426eb124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f72a89474434d5494b5e4275aaa32ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:04Z,use_quota=True,user_id='a09aa0ee14d64675a32ddfa5a46fce5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109bcdb7-7f7d-41ab-8683-df97450f5752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109bcdb7-7f7d-41ab-8683-df97450f5752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1234a27-d8d6-4cea-922f-0b791abbdb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1234a27-d8d6-4cea-922f-0b791abbdb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20ce828-a5de-4b06-b570-ccbd426eb124', 'volume_name': 'volume-f20ce828-a5de-4b06-b570-ccbd426eb124', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bbfc44-be7d-49d0-8cc6-fcbb09f0ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bbfc44-be7d-49d0-8cc6-fcbb09f0ae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7070d30c-5a37-4365-aa84-102f742dcd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Volume f20ce828-a5de-4b06-b570-ccbd426eb124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20ce828-a5de-4b06-b570-ccbd426eb124', 'volume_size': 1} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1279054490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20ce828-a5de-4b06-b570-ccbd426eb124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f72a89474434d5494b5e4275aaa32ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:04Z,use_quota=True,user_id='a09aa0ee14d64675a32ddfa5a46fce5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Creating volume f20ce828-a5de-4b06-b570-ccbd426eb124 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:04 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:04 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 1073741824 Jul 28 16:27:04 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (f0718090-8fca-4cd8-a34c-0008e009d7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ca12f9-10e1-418d-92d6-b6d88d8b9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ca12f9-10e1-418d-92d6-b6d88d8b9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-548255029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3d1213-1ef5-4171-9104-cc74923471a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:05Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9296a25-02de-46ee-a1be-8bd232d80aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9296a25-02de-46ee-a1be-8bd232d80aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35abe3af-9b5a-4482-86cd-b919d3c8ed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35abe3af-9b5a-4482-86cd-b919d3c8ed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3d1213-1ef5-4171-9104-cc74923471a5', 'volume_name': 'volume-0d3d1213-1ef5-4171-9104-cc74923471a5', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8163e1-44f2-4a69-9a71-245ce94da348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8163e1-44f2-4a69-9a71-245ce94da348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ce90ce-daee-4ae2-9b03-4a5541f0dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:04 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Volume 0d3d1213-1ef5-4171-9104-cc74923471a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3d1213-1ef5-4171-9104-cc74923471a5', 'volume_size': 1} Jul 28 16:27:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:05 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 1073741824" returned: 0 in 0.511s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:05 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 Jul 28 16:27:05 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:05 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-548255029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3d1213-1ef5-4171-9104-cc74923471a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:05Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Creating volume 0d3d1213-1ef5-4171-9104-cc74923471a5 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:05 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7070d30c-5a37-4365-aa84-102f742dcd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20ce828-a5de-4b06-b570-ccbd426eb124', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a78cac-5938-4aa3-b568-ca3962e1c35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:05 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 1073741824 Jul 28 16:27:05 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:05 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Volume volume-f20ce828-a5de-4b06-b570-ccbd426eb124 (f20ce828-a5de-4b06-b570-ccbd426eb124): created successfully Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a78cac-5938-4aa3-b568-ca3962e1c35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Flow 'volume_create_manager' (1d49a623-5ade-4055-b0c5-ff1821629381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2bf61536-e3d4-482d-ac51-577133d8d846 tempest-AttachVolumeNegativeTest-1156938776 None] Created volume successfully. Jul 28 16:27:06 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 1073741824" returned: 0 in 0.529s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:06 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 Jul 28 16:27:06 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:06 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5" returned: 0 in 0.305s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ce90ce-daee-4ae2-9b03-4a5541f0dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3d1213-1ef5-4171-9104-cc74923471a5', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73871b70-1647-44ca-9e5b-ecf6170380e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:06 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Volume volume-0d3d1213-1ef5-4171-9104-cc74923471a5 (0d3d1213-1ef5-4171-9104-cc74923471a5): created successfully Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73871b70-1647-44ca-9e5b-ecf6170380e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (f0718090-8fca-4cd8-a34c-0008e009d7fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:06 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8da7fd5c-efb6-4762-8565-7956f5a4351e tempest-VolumesActionsTest-669507295 None] Created volume successfully. Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-f2a34f95-fc48-4e2b-a517-393f4373d5c8 req-0c116a1b-4543-4c3b-9f68-c1b123fe93de tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-f2a34f95-fc48-4e2b-a517-393f4373d5c8 req-0c116a1b-4543-4c3b-9f68-c1b123fe93de tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-f2a34f95-fc48-4e2b-a517-393f4373d5c8 req-0c116a1b-4543-4c3b-9f68-c1b123fe93de tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-f2a34f95-fc48-4e2b-a517-393f4373d5c8 req-0c116a1b-4543-4c3b-9f68-c1b123fe93de tempest-AttachVolumeNegativeTest-1156938776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-f20ce828-a5de-4b06-b570-ccbd426eb124', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0584b8d1-4b78-4794-a575-c4890a4bc092', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:27:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-f2a34f95-fc48-4e2b-a517-393f4373d5c8 req-0c116a1b-4543-4c3b-9f68-c1b123fe93de tempest-AttachVolumeNegativeTest-1156938776 None] attachment_update completed successfully. Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-0d3d1213-1ef5-4171-9104-cc74923471a5-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-0d3d1213-1ef5-4171-9104-cc74923471a5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-quobyte-0d3d1213-1ef5-4171-9104-cc74923471a5" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-0d3d1213-1ef5-4171-9104-cc74923471a5" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64fd5db-953f-42c0-bfb1-e40f26cbf3b0]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:07 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 Jul 28 16:27:07 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:08 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5" returned: 0 in 0.528s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:08 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5 Jul 28 16:27:08 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:08 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d3d1213-1ef5-4171-9104-cc74923471a5" returned: 0 in 0.334s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-0d3d1213-1ef5-4171-9104-cc74923471a5" released by "delete_volume" :: held 0.922s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Created reservations ['9cc18025-7faf-41f7-91e0-38a9500470b3', 'ac7f5290-a66f-4af1-9bbd-1b353a4d906d', '3ea2e42e-a5ed-4c1c-b972-fb802796b676', 'cebc8f21-7faa-4c84-a9cf-346a1f609579'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:08 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:08 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:09 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.263s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:09 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Deleted volume successfully. Jul 28 16:27:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ff1e9b-efb4-4c20-93d2-175e65ff67e9 tempest-VolumesActionsTest-495160572 None] Lock "cinder-0d3d1213-1ef5-4171-9104-cc74923471a5-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-5e1832ee-e298-445a-9405-2013994211dd req-f193a19a-a125-4de1-9924-8148a1a83a44 tempest-AttachVolumeNegativeTest-1156938776 None] Terminate volume connection completed successfully. Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-5e1832ee-e298-445a-9405-2013994211dd req-f193a19a-a125-4de1-9924-8148a1a83a44 tempest-AttachVolumeNegativeTest-1156938776 None] Deleting attachment 0584b8d1-4b78-4794-a575-c4890a4bc092. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Flow 'volume_create_manager' (e909d4d1-9c76-493b-870b-d5f573eaf54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8e1c49-ea65-4dd2-83b8-f4dc60c875b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8e1c49-ea65-4dd2-83b8-f4dc60c875b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1356201238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90030d0-9b17-497e-a864-03a44f91711c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524ba63ebd44ca194bc705bde9e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:10Z,use_quota=True,user_id='b0e7d87459934b5092823c37c2f90ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c5116d-4d87-4a18-bc82-038adfae3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c5116d-4d87-4a18-bc82-038adfae3d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f6931f-044d-4e99-8565-b8aa07186e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f6931f-044d-4e99-8565-b8aa07186e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90030d0-9b17-497e-a864-03a44f91711c', 'volume_name': 'volume-b90030d0-9b17-497e-a864-03a44f91711c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60ee470-da56-4074-9f72-8e0edefb5373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60ee470-da56-4074-9f72-8e0edefb5373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7052c6-5a28-4945-9207-3977718ec06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Volume b90030d0-9b17-497e-a864-03a44f91711c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90030d0-9b17-497e-a864-03a44f91711c', 'volume_size': 1} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1356201238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90030d0-9b17-497e-a864-03a44f91711c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524ba63ebd44ca194bc705bde9e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:10Z,use_quota=True,user_id='b0e7d87459934b5092823c37c2f90ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Creating volume b90030d0-9b17-497e-a864-03a44f91711c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:10 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:10 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c 1073741824 Jul 28 16:27:10 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (57a1d50c-ef24-4652-8d55-541805acff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010f0717-504e-46c7-938b-fd7a89027131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010f0717-504e-46c7-938b-fd7a89027131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053382204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:11Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42f1204-23c4-449b-8e73-2a6d9267663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42f1204-23c4-449b-8e73-2a6d9267663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68271964-74f2-4398-aba6-94b048d66994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68271964-74f2-4398-aba6-94b048d66994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1', 'volume_name': 'volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d0a58d-9af5-4322-9a42-26ce10c6db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d0a58d-9af5-4322-9a42-26ce10c6db57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1cfba8-0601-4b8c-8f3b-2361d52f5a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Volume 3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1', 'volume_size': 1} Jul 28 16:27:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:11 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c 1073741824" returned: 0 in 0.524s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:11 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c Jul 28 16:27:11 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:11 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c" returned: 0 in 0.310s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053382204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:11Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Creating volume 3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:11 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7052c6-5a28-4945-9207-3977718ec06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90030d0-9b17-497e-a864-03a44f91711c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:11 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 1073741824 Jul 28 16:27:11 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1287bd-dbb0-46ce-b1db-77ab8c9c7f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:11 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Volume volume-b90030d0-9b17-497e-a864-03a44f91711c (b90030d0-9b17-497e-a864-03a44f91711c): created successfully Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1287bd-dbb0-46ce-b1db-77ab8c9c7f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Flow 'volume_create_manager' (e909d4d1-9c76-493b-870b-d5f573eaf54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cf435613-c31b-44f4-bf6d-25f3f0ca6d27 tempest-VolumesListAdminTestJSON-2109435093 None] Created volume successfully. Jul 28 16:27:12 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 1073741824" returned: 0 in 0.643s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:12 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 Jul 28 16:27:12 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:12 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1cfba8-0601-4b8c-8f3b-2361d52f5a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb4dc13-e4e9-41cb-b510-1c0284701b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:12 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Volume volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 (3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1): created successfully Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb4dc13-e4e9-41cb-b510-1c0284701b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (57a1d50c-ef24-4652-8d55-541805acff08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c73e0e44-b0fe-4c47-93ca-4c0fcdbe05fd tempest-VolumesActionsTest-669507295 None] Created volume successfully. Jul 28 16:27:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Lock "cinder-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Acquiring lock "cinder-quobyte-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1" acquired by "delete_volume" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9250516f-0d96-477f-bd88-137e04b18879]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:13 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 Jul 28 16:27:13 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Flow 'volume_create_manager' (3f795d68-33fd-4a2a-add7-d9de42b891d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31df44b0-9631-48d9-816a-9ad08e7c17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31df44b0-9631-48d9-816a-9ad08e7c17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1872635027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c042dc6d-5a01-45da-aabb-20856b56d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524ba63ebd44ca194bc705bde9e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:13Z,use_quota=True,user_id='b0e7d87459934b5092823c37c2f90ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc5c240-124a-45bc-883b-bb88009fb160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc5c240-124a-45bc-883b-bb88009fb160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9426e6eb-6e82-4311-a51e-d1a808bee69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9426e6eb-6e82-4311-a51e-d1a808bee69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c042dc6d-5a01-45da-aabb-20856b56d5b2', 'volume_name': 'volume-c042dc6d-5a01-45da-aabb-20856b56d5b2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac5fa19-e4e6-45e6-8c96-48784f359c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac5fa19-e4e6-45e6-8c96-48784f359c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab79035-a6e2-4227-804c-ce58366bcca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:13 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Volume c042dc6d-5a01-45da-aabb-20856b56d5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c042dc6d-5a01-45da-aabb-20856b56d5b2', 'volume_size': 1} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1872635027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c042dc6d-5a01-45da-aabb-20856b56d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524ba63ebd44ca194bc705bde9e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:13Z,use_quota=True,user_id='b0e7d87459934b5092823c37c2f90ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Creating volume c042dc6d-5a01-45da-aabb-20856b56d5b2 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:13 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:13 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 1073741824 Jul 28 16:27:13 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:13 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1" returned: 0 in 0.429s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:13 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1 Jul 28 16:27:13 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:13 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1" returned: 0 in 0.316s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Lock "cinder-quobyte-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1" released by "delete_volume" :: held 0.805s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:13 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Created reservations ['dae8d4cd-bbba-4104-b707-07c51cdcac4b', 'ac2ce7ba-4906-45c5-81b6-f27c9f3a8e71', '75f3d2ea-bcd8-4f8f-b9f7-7f220eb9613c', 'd27e64ec-5b4d-4442-ab3b-37c3cda58a9e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:14 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 1073741824" returned: 0 in 0.618s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:14 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:14 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:14 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 Jul 28 16:27:14 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:14 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.342s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Deleted volume successfully. Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82de9454-0e71-47f3-a349-d6d3683df5a1 tempest-VolumesActionsTest-495160572 None] Lock "cinder-3eb4b1d1-a38f-4498-81f4-3cb43fe9b1e1-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:14 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2" returned: 0 in 0.423s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab79035-a6e2-4227-804c-ce58366bcca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c042dc6d-5a01-45da-aabb-20856b56d5b2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01629348-789b-4688-a8c5-5944c9dab2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:14 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Volume volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 (c042dc6d-5a01-45da-aabb-20856b56d5b2): created successfully Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01629348-789b-4688-a8c5-5944c9dab2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Flow 'volume_create_manager' (3f795d68-33fd-4a2a-add7-d9de42b891d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5b445ee7-62ed-43cf-98a1-9b62a4b4dd3a tempest-VolumesListAdminTestJSON-2109435093 None] Created volume successfully. Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (46c4dd48-0c4b-4410-a9fc-434bb1d3bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85fc3a0-1bb7-441b-932a-920c99c6d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85fc3a0-1bb7-441b-932a-920c99c6d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858477453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f78efb6-ed56-499b-a484-575c770bc623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:15Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceee224-3daf-4b29-b74b-c58fdcada70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceee224-3daf-4b29-b74b-c58fdcada70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f993da-e29e-4186-8ff3-3b45a33ddcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f993da-e29e-4186-8ff3-3b45a33ddcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f78efb6-ed56-499b-a484-575c770bc623', 'volume_name': 'volume-8f78efb6-ed56-499b-a484-575c770bc623', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11614db-af86-469d-a947-cafc745df704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11614db-af86-469d-a947-cafc745df704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da8c55f-6d35-478d-b81a-9f66a43658ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:14 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Volume 8f78efb6-ed56-499b-a484-575c770bc623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f78efb6-ed56-499b-a484-575c770bc623', 'volume_size': 1} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858477453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f78efb6-ed56-499b-a484-575c770bc623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d1f7f93154719bfc31172ede223f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:15Z,use_quota=True,user_id='fcba42f648e64a87a723a675f688def6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Creating volume 8f78efb6-ed56-499b-a484-575c770bc623 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:14 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:14 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 1073741824 Jul 28 16:27:14 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:15 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 1073741824" returned: 0 in 0.529s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:15 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 Jul 28 16:27:15 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:15 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da8c55f-6d35-478d-b81a-9f66a43658ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f78efb6-ed56-499b-a484-575c770bc623', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181d3d30-b444-46b8-94aa-1e71dbcb2d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Volume volume-8f78efb6-ed56-499b-a484-575c770bc623 (8f78efb6-ed56-499b-a484-575c770bc623): created successfully Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181d3d30-b444-46b8-94aa-1e71dbcb2d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Flow 'volume_create_manager' (46c4dd48-0c4b-4410-a9fc-434bb1d3bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-52950ce7-16c1-4985-9d56-09eda313bd6b tempest-VolumesActionsTest-669507295 None] Created volume successfully. Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Flow 'volume_create_manager' (10f4071c-637c-474b-815b-8671b21a9a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecec7092-96f3-4acb-8edc-fac68e685aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecec7092-96f3-4acb-8edc-fac68e685aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1828171939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb7e376-9016-4206-9b29-6c78366054e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524ba63ebd44ca194bc705bde9e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:16Z,use_quota=True,user_id='b0e7d87459934b5092823c37c2f90ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c826f99-1ac7-4db4-9e7b-2b6d302edb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c826f99-1ac7-4db4-9e7b-2b6d302edb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d67d706-20d9-4a5d-ac5c-772af69c4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d67d706-20d9-4a5d-ac5c-772af69c4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb7e376-9016-4206-9b29-6c78366054e7', 'volume_name': 'volume-ffb7e376-9016-4206-9b29-6c78366054e7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606542dc-5c6f-4d87-b52d-11e79d2a4c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606542dc-5c6f-4d87-b52d-11e79d2a4c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e39cf12-8080-4a6f-bba9-343fed167ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:16 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Volume ffb7e376-9016-4206-9b29-6c78366054e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb7e376-9016-4206-9b29-6c78366054e7', 'volume_size': 1} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1828171939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb7e376-9016-4206-9b29-6c78366054e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524ba63ebd44ca194bc705bde9e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:16Z,use_quota=True,user_id='b0e7d87459934b5092823c37c2f90ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Creating volume ffb7e376-9016-4206-9b29-6c78366054e7 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:16 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:16 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 1073741824 Jul 28 16:27:16 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "cinder-f20ce828-a5de-4b06-b570-ccbd426eb124-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-f20ce828-a5de-4b06-b570-ccbd426eb124-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "cinder-quobyte-f20ce828-a5de-4b06-b570-ccbd426eb124" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-quobyte-f20ce828-a5de-4b06-b570-ccbd426eb124" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce48e297-b9d7-49ab-b85d-9c74f1029b0f]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:16 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 Jul 28 16:27:16 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:16 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 1073741824" returned: 0 in 0.551s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:16 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124" returned: 0 in 0.382s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:16 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124 Jul 28 16:27:16 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:16 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 Jul 28 16:27:16 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:16 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f20ce828-a5de-4b06-b570-ccbd426eb124" returned: 0 in 0.295s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-quobyte-f20ce828-a5de-4b06-b570-ccbd426eb124" released by "delete_volume" :: held 0.736s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:17 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e39cf12-8080-4a6f-bba9-343fed167ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb7e376-9016-4206-9b29-6c78366054e7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caedfa3-d7db-4f2f-9df2-50bf28152306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:17 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Volume volume-ffb7e376-9016-4206-9b29-6c78366054e7 (ffb7e376-9016-4206-9b29-6c78366054e7): created successfully Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caedfa3-d7db-4f2f-9df2-50bf28152306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Flow 'volume_create_manager' (10f4071c-637c-474b-815b-8671b21a9a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-47e656da-66d6-4f40-9031-2c2baea57c9a tempest-VolumesListAdminTestJSON-2109435093 None] Created volume successfully. Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Created reservations ['2d9542c3-57b2-4b0d-8f6b-d08949a9a81e', '3eb376ef-6ce2-4bdd-8018-e22a9eae6bd7', '07f613e7-a9bf-40f4-aa79-cc644b46e0b3', 'cac28622-c871-4b40-bd1b-61b7306916f7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:17 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:17 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:17 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Deleted volume successfully. Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72e4dba8-a236-4836-927f-2db00af524fe tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-f20ce828-a5de-4b06-b570-ccbd426eb124-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "cinder-00c55329-0cf5-439b-9cb0-55e983dd8a21-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-00c55329-0cf5-439b-9cb0-55e983dd8a21-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "cinder-quobyte-00c55329-0cf5-439b-9cb0-55e983dd8a21" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-quobyte-00c55329-0cf5-439b-9cb0-55e983dd8a21" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[97530ecd-7288-4634-9025-9f8251140b64]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Acquiring lock "cinder-8f78efb6-ed56-499b-a484-575c770bc623-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Lock "cinder-8f78efb6-ed56-499b-a484-575c770bc623-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:17 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 Jul 28 16:27:17 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Acquiring lock "cinder-quobyte-8f78efb6-ed56-499b-a484-575c770bc623" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Lock "cinder-quobyte-8f78efb6-ed56-499b-a484-575c770bc623" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c0943b-370d-4077-af78-f9ae164c4786]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:17 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 Jul 28 16:27:17 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:18 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21" returned: 0 in 0.406s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:18 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21 Jul 28 16:27:18 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:18 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:18 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623 Jul 28 16:27:18 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:18 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-00c55329-0cf5-439b-9cb0-55e983dd8a21" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-quobyte-00c55329-0cf5-439b-9cb0-55e983dd8a21" released by "delete_volume" :: held 0.763s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Created reservations ['1168f0c1-00c4-4fad-81a2-9358c760cf96', '66982d31-11b4-41cc-80a1-16771ed2a7f0', '5bf4d2ce-6068-4845-8705-ff8349215ce7', '2e44f463-438a-4140-a6e4-ae0578e3c107'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:18 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:18 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:18 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8f78efb6-ed56-499b-a484-575c770bc623" returned: 0 in 0.294s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Lock "cinder-quobyte-8f78efb6-ed56-499b-a484-575c770bc623" released by "delete_volume" :: held 0.774s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Created reservations ['011fc75c-d0dd-4972-a5a9-80ea42df16f7', '0df5c670-6a9a-46f2-acb2-ad1b518a39ee', 'd96dfc47-bdf1-4966-8eb9-9c341d4a6fbe', 'b75bfdb8-f87b-403f-a830-9d821c189e86'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:18 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:18 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:18 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.380s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Deleted volume successfully. Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fdae78e1-c08c-4a06-b1c4-9b42655e2169 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-00c55329-0cf5-439b-9cb0-55e983dd8a21-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "cinder-73c6a244-a403-49be-b31e-7736d4d0b09a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-73c6a244-a403-49be-b31e-7736d4d0b09a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Flow 'volume_create_manager' (9fae894f-95af-4cd9-bdf3-f53c8e618a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9231a5-4ba0-4e71-96ed-b573b35474ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:19 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "cinder-quobyte-73c6a244-a403-49be-b31e-7736d4d0b09a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.336s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:19 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Deleted volume successfully. Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9231a5-4ba0-4e71-96ed-b573b35474ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d05e10-b203-405e-ba56-f0b4c37297aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ba36e01ceb4afca7f16835e589bfb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:19Z,use_quota=True,user_id='12f55c2e747d45e6b2c7dc1877a02d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4801e9-4f9c-4311-97f2-35d10c71059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4801e9-4f9c-4311-97f2-35d10c71059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a84034-6738-4c2a-8e06-dec3123feccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a84034-6738-4c2a-8e06-dec3123feccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d05e10-b203-405e-ba56-f0b4c37297aa', 'volume_name': 'volume-76d05e10-b203-405e-ba56-f0b4c37297aa', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e0e9d0-0947-4546-aca5-1842c18bc7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e0e9d0-0947-4546-aca5-1842c18bc7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a4e248-15a7-4b28-aafc-230e5689bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:19 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Volume 76d05e10-b203-405e-ba56-f0b4c37297aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d05e10-b203-405e-ba56-f0b4c37297aa', 'volume_size': 1} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d05e10-b203-405e-ba56-f0b4c37297aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ba36e01ceb4afca7f16835e589bfb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:19Z,use_quota=True,user_id='12f55c2e747d45e6b2c7dc1877a02d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Creating volume 76d05e10-b203-405e-ba56-f0b4c37297aa {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:19 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-quobyte-73c6a244-a403-49be-b31e-7736d4d0b09a" acquired by "delete_volume" :: waited 0.096s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:19 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa 1073741824 Jul 28 16:27:19 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-00c64b70-3eb3-4902-bf79-06847dd2bb29 tempest-VolumesActionsTest-669507295 None] Lock "cinder-8f78efb6-ed56-499b-a484-575c770bc623-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2385440-ea21-4060-8ead-7320dbe9f502]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:19 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a Jul 28 16:27:19 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:19 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a" returned: 0 in 0.409s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:19 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a Jul 28 16:27:19 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:19 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa 1073741824" returned: 0 in 0.519s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:19 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa Jul 28 16:27:19 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:20 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-73c6a244-a403-49be-b31e-7736d4d0b09a" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-quobyte-73c6a244-a403-49be-b31e-7736d4d0b09a" released by "delete_volume" :: held 0.841s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:20 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a4e248-15a7-4b28-aafc-230e5689bcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d05e10-b203-405e-ba56-f0b4c37297aa', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39898f56-7b26-470b-a2e3-258c01fbb729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:20 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Volume volume-76d05e10-b203-405e-ba56-f0b4c37297aa (76d05e10-b203-405e-ba56-f0b4c37297aa): created successfully Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39898f56-7b26-470b-a2e3-258c01fbb729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Flow 'volume_create_manager' (9fae894f-95af-4cd9-bdf3-f53c8e618a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Created reservations ['ced625ba-fb7c-4228-8cc9-492ecbb355df', '63213cb3-cf27-4f4a-8a2d-a9ad500f6bf1', 'b00cc74c-fe76-450d-bbaf-347a81e8742c', '620b1672-21f7-4222-8837-1c8c43d7a275'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-735af934-3f58-4a6e-a45e-1c85277f2d5c tempest-VolumesListAdminTestJSON-913564609 None] Created volume successfully. Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:20 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:20 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:20 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.277s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Deleted volume successfully. Jul 28 16:27:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ee69f5f-ce44-4dec-832a-685ac26b5fe7 tempest-AttachVolumeNegativeTest-1156938776 None] Lock "cinder-73c6a244-a403-49be-b31e-7736d4d0b09a-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Acquiring lock "cinder-76d05e10-b203-405e-ba56-f0b4c37297aa-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Lock "cinder-76d05e10-b203-405e-ba56-f0b4c37297aa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Acquiring lock "cinder-quobyte-76d05e10-b203-405e-ba56-f0b4c37297aa" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Lock "cinder-quobyte-76d05e10-b203-405e-ba56-f0b4c37297aa" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eff96d4-20c6-473b-916f-62ddd9cd446a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "cinder-ffb7e376-9016-4206-9b29-6c78366054e7-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-ffb7e376-9016-4206-9b29-6c78366054e7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "cinder-quobyte-ffb7e376-9016-4206-9b29-6c78366054e7" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-quobyte-ffb7e376-9016-4206-9b29-6c78366054e7" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:21 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa Jul 28 16:27:21 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[07256a89-6fde-41d4-bc12-bf8ad3b4d7e6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:21 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 Jul 28 16:27:21 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:21 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa" returned: 0 in 0.501s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:21 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa Jul 28 16:27:21 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:21 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7" returned: 0 in 0.470s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:21 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7 Jul 28 16:27:21 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:22 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-76d05e10-b203-405e-ba56-f0b4c37297aa" returned: 0 in 0.310s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Lock "cinder-quobyte-76d05e10-b203-405e-ba56-f0b4c37297aa" released by "delete_volume" :: held 0.914s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Created reservations ['08204a28-dc40-4338-9629-4213c71547b0', '4a415439-0a58-480d-8bd7-341712f40959', '84d841b0-0e6e-4fb8-a25e-b9b04dd6f1e9', '11c4a3d4-5ef7-4d6a-aa6d-044c4986c30e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:22 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:22 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:22 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ffb7e376-9016-4206-9b29-6c78366054e7" returned: 0 in 0.482s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-quobyte-ffb7e376-9016-4206-9b29-6c78366054e7" released by "delete_volume" :: held 1.012s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Created reservations ['14815d22-a6cf-4edb-8cfe-99a06c8040ef', 'ab9eff4e-577d-4432-8a15-791b1698f458', '2042110e-7973-4195-8166-1a9c7d5b4436', '6455556b-caac-48ad-81ee-3445dc1ca9d8'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:22 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:22 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:22 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.394s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Deleted volume successfully. Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12c4cb37-bab1-4345-8537-6cee533f12e2 tempest-VolumesListAdminTestJSON-913564609 None] Lock "cinder-76d05e10-b203-405e-ba56-f0b4c37297aa-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:22 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.273s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Deleted volume successfully. Jul 28 16:27:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fe3a94-f97d-41ac-b8c4-32f1079e4e0c tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-ffb7e376-9016-4206-9b29-6c78366054e7-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "cinder-c042dc6d-5a01-45da-aabb-20856b56d5b2-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-c042dc6d-5a01-45da-aabb-20856b56d5b2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "cinder-quobyte-c042dc6d-5a01-45da-aabb-20856b56d5b2" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-quobyte-c042dc6d-5a01-45da-aabb-20856b56d5b2" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a6290-d600-48c7-ad52-340a9c2c58b8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:24 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 Jul 28 16:27:24 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:24 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:24 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2 Jul 28 16:27:24 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:24 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c042dc6d-5a01-45da-aabb-20856b56d5b2" returned: 0 in 0.270s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-quobyte-c042dc6d-5a01-45da-aabb-20856b56d5b2" released by "delete_volume" :: held 0.810s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:24 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Created reservations ['d0e82371-36dc-4ba9-ba26-f9c431dee40d', '0fd18fae-dc2e-46e9-88ca-d05acc733fee', 'c73fcfa4-0124-486a-bf17-45c7cf5dbaa8', '930979c0-bffe-427a-8084-44213f147a9f'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:25 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:25 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "cinder-b90030d0-9b17-497e-a864-03a44f91711c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-b90030d0-9b17-497e-a864-03a44f91711c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "cinder-quobyte-b90030d0-9b17-497e-a864-03a44f91711c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-quobyte-b90030d0-9b17-497e-a864-03a44f91711c" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7edf23b-5b03-4b72-b25d-98bfbadb9a6f]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:25 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.360s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Deleted volume successfully. Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ca82fd07-c6f9-4cac-99ba-2a702900df8b tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-c042dc6d-5a01-45da-aabb-20856b56d5b2-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:25 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c Jul 28 16:27:25 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:25 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c" returned: 0 in 0.500s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:25 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c Jul 28 16:27:25 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:26 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b90030d0-9b17-497e-a864-03a44f91711c" returned: 0 in 0.372s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-quobyte-b90030d0-9b17-497e-a864-03a44f91711c" released by "delete_volume" :: held 0.931s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Created reservations ['d4adc837-213a-4469-bba5-c55fb26468c5', 'f753722e-182b-4442-985a-a0f0d064e9a0', '27794d7f-6873-4f8a-a99e-78e30c2d4559', 'ae72abcb-5e2d-4cf8-be74-99fffc6235e3'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:26 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:26 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:26 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.323s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Deleted volume successfully. Jul 28 16:27:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0db9c56-593e-4763-b09d-6ddb36a14935 tempest-VolumesListAdminTestJSON-2109435093 None] Lock "cinder-b90030d0-9b17-497e-a864-03a44f91711c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Flow 'volume_create_manager' (aa197e0d-fd83-46b6-92d7-fa1b21822e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08876b6-3524-4ea7-b3bc-1706442c88b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08876b6-3524-4ea7-b3bc-1706442c88b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-648843358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69da0238-e168-4815-a958-42bca84b8103,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1051b273303b4d8e86aaf473d02c130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:31Z,use_quota=True,user_id='5cf24178c01443e485dc8fdcd43a4852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774a25ac-03a4-47c8-abfb-8397fb50cc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774a25ac-03a4-47c8-abfb-8397fb50cc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3be55f7-ad21-4fdc-ab79-1e9c0855f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3be55f7-ad21-4fdc-ab79-1e9c0855f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69da0238-e168-4815-a958-42bca84b8103', 'volume_name': 'volume-69da0238-e168-4815-a958-42bca84b8103', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e804bad3-b9a4-46fc-9f21-5df75ab8e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e804bad3-b9a4-46fc-9f21-5df75ab8e50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985070bc-579c-4589-82ef-beddfc587bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:31 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Volume 69da0238-e168-4815-a958-42bca84b8103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69da0238-e168-4815-a958-42bca84b8103', 'volume_size': 1} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-648843358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69da0238-e168-4815-a958-42bca84b8103,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1051b273303b4d8e86aaf473d02c130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:31Z,use_quota=True,user_id='5cf24178c01443e485dc8fdcd43a4852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Creating volume 69da0238-e168-4815-a958-42bca84b8103 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:31 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:31 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 1073741824 Jul 28 16:27:31 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:31 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 1073741824" returned: 0 in 0.604s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:31 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 Jul 28 16:27:31 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:32 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103" returned: 0 in 0.407s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985070bc-579c-4589-82ef-beddfc587bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69da0238-e168-4815-a958-42bca84b8103', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59485eb-ed74-474c-bd94-2e2503f5e8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:32 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Volume volume-69da0238-e168-4815-a958-42bca84b8103 (69da0238-e168-4815-a958-42bca84b8103): created successfully Jul 28 16:27:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59485eb-ed74-474c-bd94-2e2503f5e8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Flow 'volume_create_manager' (aa197e0d-fd83-46b6-92d7-fa1b21822e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-98a0b305-a16d-411d-aa61-c3cbca0e4cbf req-a5beaf26-c1d5-4705-a83c-5b80f2556473 tempest-VolumesGetTestJSON-1088594588 None] Created volume successfully. Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Flow 'volume_create_manager' (3d2190b9-5caa-421f-9c16-6b795a79f51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85d7ce6-fbed-43c5-b514-b7c715b28b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85d7ce6-fbed-43c5-b514-b7c715b28b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1351094072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3b920f-b0eb-45cd-9508-02db58c35317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7b3703f1f470e8e85077571644a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:33Z,use_quota=True,user_id='0603e3c6ae8949e28696b9e23644aa97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f808f4e-e60e-4efa-b309-6ebd7c1105f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f808f4e-e60e-4efa-b309-6ebd7c1105f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611f799d-4d1f-4823-9131-151a78b2c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611f799d-4d1f-4823-9131-151a78b2c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3b920f-b0eb-45cd-9508-02db58c35317', 'volume_name': 'volume-0f3b920f-b0eb-45cd-9508-02db58c35317', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6008b1b6-3fe8-4130-912b-013b1a336f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6008b1b6-3fe8-4130-912b-013b1a336f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea5d100-6632-4531-b839-2656a2e3caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:33 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Volume 0f3b920f-b0eb-45cd-9508-02db58c35317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3b920f-b0eb-45cd-9508-02db58c35317', 'volume_size': 1} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1351094072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3b920f-b0eb-45cd-9508-02db58c35317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7b3703f1f470e8e85077571644a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:33Z,use_quota=True,user_id='0603e3c6ae8949e28696b9e23644aa97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Creating volume 0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:33 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:33 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 1073741824 Jul 28 16:27:33 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Acquiring lock "cinder-69da0238-e168-4815-a958-42bca84b8103-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Lock "cinder-69da0238-e168-4815-a958-42bca84b8103-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Acquiring lock "cinder-quobyte-69da0238-e168-4815-a958-42bca84b8103" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Lock "cinder-quobyte-69da0238-e168-4815-a958-42bca84b8103" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a35d1-6a0f-402a-b08a-4da6f192a0d3]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:33 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 1073741824" returned: 0 in 0.617s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:34 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 Jul 28 16:27:34 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:34 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 Jul 28 16:27:34 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:34 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea5d100-6632-4531-b839-2656a2e3caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3b920f-b0eb-45cd-9508-02db58c35317', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bc791c-216c-4379-bc36-617e6311fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:34 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103" returned: 0 in 0.424s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:34 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Volume volume-0f3b920f-b0eb-45cd-9508-02db58c35317 (0f3b920f-b0eb-45cd-9508-02db58c35317): created successfully Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bc791c-216c-4379-bc36-617e6311fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Flow 'volume_create_manager' (3d2190b9-5caa-421f-9c16-6b795a79f51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:34 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103 Jul 28 16:27:34 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:34 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-20a74ab6-6d1a-42ef-ae48-4d644fdd0305 tempest-VolumesDeleteCascade-2046809666 None] Created volume successfully. Jul 28 16:27:34 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-69da0238-e168-4815-a958-42bca84b8103" returned: 0 in 0.285s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Lock "cinder-quobyte-69da0238-e168-4815-a958-42bca84b8103" released by "delete_volume" :: held 0.760s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.quota [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Created reservations ['259a0fac-43d4-42e5-8200-f081d1d7ae5c', '9807b919-2f10-420d-8ae5-d8ff2a1da452', 'dc963024-4304-4dd6-9bed-3a802219df5d', '4327886d-4e54-4ea7-b557-1285611b0bdc'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:34 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:34 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:35 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.277s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG cinder.manager [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Deleted volume successfully. Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-d4a1c8dc-f206-4480-a64e-acc32daceb9a req-cec416cd-a323-4c83-8d65-85d58fa743a5 tempest-VolumesGetTestJSON-1088594588 None] Lock "cinder-69da0238-e168-4815-a958-42bca84b8103-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Creating offline snapshot 9829d09a-cea9-4456-9f94-11c555e801c2 of volume 0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e066a1-5294-4c70-96ff-0f3cf238f60d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:35 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 Jul 28 16:27:35 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Flow 'volume_create_manager' (50bd68ec-d913-44c6-846a-439f407fac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb870d30-742c-4bdc-8618-1205f14bbb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb870d30-742c-4bdc-8618-1205f14bbb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1031284857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1131f0cd6a594c729718b46f64863195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:36Z,use_quota=True,user_id='b8beba0c164549f1839ff1e623d73c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf79d1-45c2-4af6-8dbb-9dd4f6adada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf79d1-45c2-4af6-8dbb-9dd4f6adada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8132c80d-064b-4983-921a-f403146ae85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8132c80d-064b-4983-921a-f403146ae85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80', 'volume_name': 'volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc567e8c-ad54-4951-b2ca-74755512c04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc567e8c-ad54-4951-b2ca-74755512c04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82deee10-d49b-4d59-858f-a2f0aa57190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:36 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Volume 2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80', 'volume_size': 1} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:36 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317" returned: 0 in 0.454s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:36 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 1G Jul 28 16:27:36 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:36 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 1G" returned: 0 in 0.460s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b920f-b0eb-45cd-9508-02db58c35317 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:36 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b920f-b0eb-45cd-9508-02db58c35317 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 Jul 28 16:27:36 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:36 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b920f-b0eb-45cd-9508-02db58c35317 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2" returned: 0 in 0.361s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:36 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 is being set with open permissions: ugo+rw Jul 28 16:27:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:36 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 Jul 28 16:27:36 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:37 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2" returned: 0 in 0.265s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:37 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.info Jul 28 16:27:37 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:37 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.info" returned: 0 in 0.270s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:37 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.info is being set with open permissions: ugo+rw Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:37 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.info Jul 28 16:27:37 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:37 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.info" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1031284857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1131f0cd6a594c729718b46f64863195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:36Z,use_quota=True,user_id='b8beba0c164549f1839ff1e623d73c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Creating volume 2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:37 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:37 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 1073741824 Jul 28 16:27:37 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e4897549-1d31-4479-9ab1-e2f255eae38c tempest-VolumesDeleteCascade-2046809666 None] Create snapshot completed successfully Jul 28 16:27:38 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 1073741824" returned: 0 in 0.490s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:38 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 Jul 28 16:27:38 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:38 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80" returned: 0 in 0.255s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82deee10-d49b-4d59-858f-a2f0aa57190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febdddfc-b752-4eb4-b3bb-58587f562bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:38 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Volume volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 (2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80): created successfully Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febdddfc-b752-4eb4-b3bb-58587f562bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Flow 'volume_create_manager' (50bd68ec-d913-44c6-846a-439f407fac01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:38 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-424e3e3a-4b98-445b-8b08-93155a62d8b3 tempest-AbsoluteLimitsTests-1197974358 None] Created volume successfully. Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Creating offline snapshot 3b829f9f-b590-4971-8d86-58ce4ba35e63 of volume 0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a84c52f-8bf2-40b9-98b6-5974eb5ab73a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-89b77ab9-de26-44ae-9f40-e3fcf103b260 tempest-BackendsCapabilitiesAdminTestsJSON-2031073383 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757698059082, 'free_capacity_gb': 1775.757698059082, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88286) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-76aa10af-2810-440f-8893-0924242dee21 tempest-BackendsCapabilitiesAdminTestsJSON-2031073383 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757698059082, 'free_capacity_gb': 1775.757698059082, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88286) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 16:27:39 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 Jul 28 16:27:39 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Acquiring lock "cinder-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Lock "cinder-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Acquiring lock "cinder-quobyte-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Lock "cinder-quobyte-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63298b1-d5dd-4a0c-ae28-6fea064701fa]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:39 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2" returned: 0 in 0.451s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3b920f-b0eb-45cd-9508-02db58c35317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:39 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 1G Jul 28 16:27:39 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:39 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 Jul 28 16:27:39 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:39 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80" returned: 0 in 0.418s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:39 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80 Jul 28 16:27:39 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:40 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 1G" returned: 0 in 0.558s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:40 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 Jul 28 16:27:40 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:40 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80" returned: 0 in 0.335s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Lock "cinder-quobyte-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80" released by "delete_volume" :: held 0.807s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Created reservations ['67f9b1ee-61c6-45c8-9c38-63e144016c57', 'd4deb7b7-a2ce-414f-a728-59037cb871ed', 'abe983b1-ca1b-4c0f-b9ba-4b387d74c508', 'ea4f0b6c-1148-49a9-90db-333477ae82e4'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:40 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:40 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:40 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63" returned: 0 in 0.386s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:40 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 is being set with open permissions: ugo+rw Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:40 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 Jul 28 16:27:40 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:40 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.314s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:40 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Deleted volume successfully. Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-edf17b59-277d-4a52-bb16-6d66bf62fcde tempest-AbsoluteLimitsTests-1197974358 None] Lock "cinder-2800b7f0-d6e4-49fd-8b45-5a8cb9d24c80-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:40 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63" returned: 0 in 0.323s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:40 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3a580188-921c-4165-ac88-7622ace07ac1 tempest-VolumesDeleteCascade-2046809666 None] Create snapshot completed successfully Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:41 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:41 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-0f3b920f-b0eb-45cd-9508-02db58c35317-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-0f3b920f-b0eb-45cd-9508-02db58c35317-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=183,cinder:SELECT=128,cinder:INSERT=36,cinder:DELETE=8 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Performing cascade delete. {{(pid=88286) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-3b829f9f-b590-4971-8d86-58ce4ba35e63-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-3b829f9f-b590-4971-8d86-58ce4ba35e63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-3b829f9f-b590-4971-8d86-58ce4ba35e63" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-3b829f9f-b590-4971-8d86-58ce4ba35e63" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Deleting offline snapshot 3b829f9f-b590-4971-8d86-58ce4ba35e63 of volume 0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] snapshot_file for this snap is: volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[844bd6ce-8297-4e8e-bac0-a7ffbbac98c8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:41 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.395s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:27:41 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 Jul 28 16:27:41 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:41 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63" returned: 0 in 0.505s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3b920f-b0eb-45cd-9508-02db58c35317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:27:42 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[16189486-a0d1-4a86-b7e0-f9b49c2df569]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:42 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 Jul 28 16:27:42 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:42 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2" returned: 0 in 0.479s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3b920f-b0eb-45cd-9508-02db58c35317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:27:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:42 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 Jul 28 16:27:42 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:43 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63" returned: 0 in 0.552s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:43 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63 Jul 28 16:27:43 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:43 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.3b829f9f-b590-4971-8d86-58ce4ba35e63" returned: 0 in 0.358s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-3b829f9f-b590-4971-8d86-58ce4ba35e63" released by "_delete_snapshot" :: held 2.047s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" released by "delete_snapshot" :: held 2.079s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=138,cinder:UPDATE=179,cinder:DELETE=25,cinder:INSERT=46 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Created reservations ['bd3c4583-51d9-4ba0-bec0-45d0197809a3', 'da466b26-2f1f-49df-b92e-28088c079f98', 'e2f8eb42-fdde-4284-a7d6-39e21b16ab35', '26718a2e-a483-4f1d-a186-4c64cc2992d9'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Delete snapshot completed successfully. Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-3b829f9f-b590-4971-8d86-58ce4ba35e63-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-9829d09a-cea9-4456-9f94-11c555e801c2-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-9829d09a-cea9-4456-9f94-11c555e801c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-9829d09a-cea9-4456-9f94-11c555e801c2" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-9829d09a-cea9-4456-9f94-11c555e801c2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Deleting offline snapshot 9829d09a-cea9-4456-9f94-11c555e801c2 of volume 0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] snapshot_file for this snap is: volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[94819e65-dec1-4bfc-875c-a52734812c63]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:43 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 Jul 28 16:27:43 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:44 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2" returned: 0 in 0.421s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3b920f-b0eb-45cd-9508-02db58c35317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:27:44 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c57c23-ad25-432e-b789-4a161902d275]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:44 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 Jul 28 16:27:44 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:44 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317" returned: 0 in 0.471s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:44 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 Jul 28 16:27:44 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:45 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2" returned: 0 in 0.411s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:45 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2 Jul 28 16:27:45 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:45 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317.9829d09a-cea9-4456-9f94-11c555e801c2" returned: 0 in 0.323s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-9829d09a-cea9-4456-9f94-11c555e801c2" released by "_delete_snapshot" :: held 1.763s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" released by "delete_snapshot" :: held 1.790s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Created reservations ['b9a23309-99fb-449f-a0a6-051d9c9ce140', '9385348a-e216-4d18-be87-684b3532066d', '5ba2480d-63d3-4c3e-bd03-f6680a2e3f81', '587e111d-eda6-44c3-90c8-736a815e81ed'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-87d80698-e420-4b4f-9224-9bff53a24dd5 tempest-GroupSnapshotsTest-369984384 None] Group tempest-GroupSnapshotsTest-Group-1035430828: creating Jul 28 16:27:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Delete snapshot completed successfully. Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-9829d09a-cea9-4456-9f94-11c555e801c2-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Snapshots deleted, issuing volume delete {{(pid=88286) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-87d80698-e420-4b4f-9224-9bff53a24dd5 tempest-GroupSnapshotsTest-369984384 None] Group tempest-GroupSnapshotsTest-Group-1035430828: created successfully Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-87d80698-e420-4b4f-9224-9bff53a24dd5 tempest-GroupSnapshotsTest-369984384 None] Create group completed successfully. Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9c6f5-cfe0-48e4-89f5-6a9d72c9bba6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:45 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 Jul 28 16:27:45 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:46 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317" returned: 0 in 0.407s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:46 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317 Jul 28 16:27:46 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:46 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0f3b920f-b0eb-45cd-9508-02db58c35317" returned: 0 in 0.295s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-0f3b920f-b0eb-45cd-9508-02db58c35317" released by "delete_volume" :: held 0.764s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Created reservations ['d64873e1-7c39-4990-9d2f-2aaf77aa9aa0', '4dd83977-9f9c-4281-b649-5487fa04fae9', '505340d7-e902-477a-9a06-fc12625bdc95', '6739e97e-5128-4653-9dbc-2fd7d8c9abfd'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:46 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:27:46 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:46 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:46 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:27:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Deleted volume successfully. Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5fb0e2f5-72e6-4dcd-aace-b0244ac1cd21 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-0f3b920f-b0eb-45cd-9508-02db58c35317-delete_volume" released by "delete_volume" :: held 5.821s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (7e0ab1bc-1bda-47c0-a033-4f0eb98f0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec2e800-1732-4799-972c-764a90379cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec2e800-1732-4799-972c-764a90379cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-218427967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1e7b7ed-a790-49fb-aee8-c90b655f80ce,host='devstack@QuobyteHD#QuobyteHD',id=144f9a0e-9f02-4514-aa2e-b86d17e68dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:48Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c687961-abfc-42ad-84ca-3a3c1a609233),volume_type_id=1c687961-abfc-42ad-84ca-3a3c1a609233)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1280cc1-a1f1-4334-af0a-57045f97440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1280cc1-a1f1-4334-af0a-57045f97440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b638ce-c515-4e73-8c5e-c82c6c23586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b638ce-c515-4e73-8c5e-c82c6c23586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144f9a0e-9f02-4514-aa2e-b86d17e68dbc', 'volume_name': 'volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf943f52-2e94-4f65-9df4-983bd7c85cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf943f52-2e94-4f65-9df4-983bd7c85cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655c8bb0-011e-4819-8e79-165778ec8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Volume 144f9a0e-9f02-4514-aa2e-b86d17e68dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc', 'volume_size': 1} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1e7b7ed-a790-49fb-aee8-c90b655f80ce,created_at=2026-07-28T14:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-218427967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1e7b7ed-a790-49fb-aee8-c90b655f80ce,host='devstack@QuobyteHD#QuobyteHD',id=144f9a0e-9f02-4514-aa2e-b86d17e68dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:48Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c687961-abfc-42ad-84ca-3a3c1a609233),volume_type_id=1c687961-abfc-42ad-84ca-3a3c1a609233)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Creating volume 144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:47 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:47 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc 1073741824 Jul 28 16:27:47 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Flow 'volume_create_manager' (3bee00ba-2d32-4e5c-ae8b-6ec8ebf17331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad64d9cd-c9bf-40dd-bc0b-e51f8dcf0266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad64d9cd-c9bf-40dd-bc0b-e51f8dcf0266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1163982271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ece630-93a6-41c7-ac61-d23d8bc1a7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7b3703f1f470e8e85077571644a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:48Z,use_quota=True,user_id='0603e3c6ae8949e28696b9e23644aa97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3be4ea1-23e6-4fce-968e-d683e036ccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3be4ea1-23e6-4fce-968e-d683e036ccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2931ee95-14a9-43b4-b26a-672837ed0585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2931ee95-14a9-43b4-b26a-672837ed0585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ece630-93a6-41c7-ac61-d23d8bc1a7fe', 'volume_name': 'volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22504956-bbf1-408a-912e-b31685851a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22504956-bbf1-408a-912e-b31685851a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241f097-2bc0-42e1-bd62-5c213008b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Volume 08ece630-93a6-41c7-ac61-d23d8bc1a7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe', 'volume_size': 1} Jul 28 16:27:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:48 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc 1073741824" returned: 0 in 0.489s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:48 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc Jul 28 16:27:48 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:48 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1163982271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ece630-93a6-41c7-ac61-d23d8bc1a7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7b3703f1f470e8e85077571644a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:48Z,use_quota=True,user_id='0603e3c6ae8949e28696b9e23644aa97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Creating volume 08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:48 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:48 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe 1073741824 Jul 28 16:27:48 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655c8bb0-011e-4819-8e79-165778ec8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876811f0-45fe-4603-ba70-f136ebb38903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:48 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Volume volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc (144f9a0e-9f02-4514-aa2e-b86d17e68dbc): created successfully Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876811f0-45fe-4603-ba70-f136ebb38903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (7e0ab1bc-1bda-47c0-a033-4f0eb98f0511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:48 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8f5d734d-64db-460e-9017-0845c4c34ecc tempest-GroupSnapshotsTest-369984384 None] Created volume successfully. Jul 28 16:27:49 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe 1073741824" returned: 0 in 0.532s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:49 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe Jul 28 16:27:49 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:49 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" returned: 0 in 0.279s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241f097-2bc0-42e1-bd62-5c213008b52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838bcc54-00f1-4add-ae7a-ff35adba2a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:49 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Volume volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe (08ece630-93a6-41c7-ac61-d23d8bc1a7fe): created successfully Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838bcc54-00f1-4add-ae7a-ff35adba2a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Flow 'volume_create_manager' (3bee00ba-2d32-4e5c-ae8b-6ec8ebf17331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-093710e8-7ec4-4fd8-8de4-9afad829951b tempest-VolumesDeleteCascade-2046809666 None] Created volume successfully. Jul 28 16:27:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] GroupSnapshot f218d7e0-3ec3-49a8-9e3b-aad4d4191d87: creating. Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Group snapshot f218d7e0-3ec3-49a8-9e3b-aad4d4191d87: creating. {{(pid=88286) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Creating offline snapshot 8bffa7b3-3278-40c3-a116-9b98d5e08106 of volume 144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[50837da0-53df-4dca-8efe-b4f28aac0aa8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:50 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc Jul 28 16:27:50 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:50 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:50 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 1G Jul 28 16:27:50 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:51 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 1G" returned: 0 in 0.500s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:51 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 Jul 28 16:27:51 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:51 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106" returned: 0 in 0.322s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:51 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:27:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:51 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 Jul 28 16:27:51 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:51 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106" returned: 0 in 0.276s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:52 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.info Jul 28 16:27:52 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:52 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.info" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:52 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:52 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.info Jul 28 16:27:52 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:52 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.info" returned: 0 in 0.259s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.474s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Creating offline snapshot dd585a7d-e718-4096-8157-81a32becc52c of volume 08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acfe610-b8bf-48ff-8426-157ed2f392d6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1d8af0c7-97ad-46e2-a418-13eda7068c79 tempest-GroupSnapshotsTest-369984384 None] group_snapshot f218d7e0-3ec3-49a8-9e3b-aad4d4191d87: created successfully Jul 28 16:27:52 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe Jul 28 16:27:52 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:53 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" returned: 0 in 0.421s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:53 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c 1G Jul 28 16:27:53 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:53 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c 1G" returned: 0 in 0.560s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:53 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c Jul 28 16:27:53 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:54 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c" returned: 0 in 0.601s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:54 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c is being set with open permissions: ugo+rw Jul 28 16:27:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:54 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c Jul 28 16:27:54 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:54 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:54 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.info Jul 28 16:27:54 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:54 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.info" returned: 0 in 0.284s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:54 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.info is being set with open permissions: ugo+rw Jul 28 16:27:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:54 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.info Jul 28 16:27:54 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:55 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.info" returned: 0 in 0.261s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.831s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-8bffa7b3-3278-40c3-a116-9b98d5e08106-784923e0-1893-472e-9973-754592542ebf" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-8bffa7b3-3278-40c3-a116-9b98d5e08106-784923e0-1893-472e-9973-754592542ebf" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Creating volume 784923e0-1893-472e-9973-754592542ebf from snapshot 8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-784923e0-1893-472e-9973-754592542ebf" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:27:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8f8ed3ac-7573-4b95-89cd-1b9b4ed229c9 tempest-VolumesDeleteCascade-2046809666 None] Create snapshot completed successfully Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-784923e0-1893-472e-9973-754592542ebf" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] snapshot: 8bffa7b3-3278-40c3-a116-9b98d5e08106, volume: 784923e0-1893-472e-9973-754592542ebf, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb55ef0-d625-4ed5-8845-2d04877e2e33]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:55 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 Jul 28 16:27:55 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:55 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a71df-16f9-4ac2-aebb-f0e0b8e67bb9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:27:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:55 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc Jul 28 16:27:55 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:56 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 28 16:27:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" returned: 0 in 0.439s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:27:56 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:27:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:27:56 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf Jul 28 16:27:56 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Flow 'volume_create_manager' (a5c83bb9-eac0-4aa5-a045-fceb44ed60e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b220005c-36e2-42a8-8508-40ca067491f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b220005c-36e2-42a8-8508-40ca067491f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1332860340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08793add-2b66-4b5d-a68d-34d4d4d5969b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7b3703f1f470e8e85077571644a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd585a7d-e718-4096-8157-81a32becc52c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:27:57Z,use_quota=True,user_id='0603e3c6ae8949e28696b9e23644aa97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a888c3-6356-4ae6-95dd-380f79eb92bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a888c3-6356-4ae6-95dd-380f79eb92bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18b024b-711c-4eee-b275-fbb7c374ea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18b024b-711c-4eee-b275-fbb7c374ea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08793add-2b66-4b5d-a68d-34d4d4d5969b', 'volume_name': 'volume-08793add-2b66-4b5d-a68d-34d4d4d5969b', 'volume_size': 1, 'snapshot_id': 'dd585a7d-e718-4096-8157-81a32becc52c'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418a6e2e-2897-4a2b-8cf0-766e813c53a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418a6e2e-2897-4a2b-8cf0-766e813c53a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560f2133-ff87-48a5-82d3-38ec5d32f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:27:57 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Volume 08793add-2b66-4b5d-a68d-34d4d4d5969b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08793add-2b66-4b5d-a68d-34d4d4d5969b', 'volume_size': 1, 'snapshot_id': 'dd585a7d-e718-4096-8157-81a32becc52c'} Jul 28 16:27:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Flow 'volume_create_manager' (8173c4d6-c63d-4977-afae-7cf2bb133d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c421f26-208d-429c-b2cb-1f5cfb73dc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c421f26-208d-429c-b2cb-1f5cfb73dc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1167818844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a099aa3-0f93-4de5-a16f-6767cc9b630a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcffc504e0644fe8bcbb42896c7281f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:01Z,use_quota=True,user_id='86b9d1b9cdde45a3a2dc3178612db5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5872c480-c1f1-4dab-a649-63615a089083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5872c480-c1f1-4dab-a649-63615a089083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd981bf0-7c88-4e93-8602-2b951810d949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd981bf0-7c88-4e93-8602-2b951810d949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a099aa3-0f93-4de5-a16f-6767cc9b630a', 'volume_name': 'volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5fc2a5-a294-4d61-bbba-28a136e5344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5fc2a5-a294-4d61-bbba-28a136e5344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817844d8-a40e-48a6-a2a5-e1b40f12a310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Volume 8a099aa3-0f93-4de5-a16f-6767cc9b630a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a', 'volume_size': 1} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:01 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf" returned: 0 in 5.563s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f297950-fc2e-4be6-b101-eb80654b3d5b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:01 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc Jul 28 16:28:01 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:02 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" returned: 0 in 0.536s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:28:02 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Converted 1024.00 MB image at 184.04 MB/s Jul 28 16:28:02 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:02 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf Jul 28 16:28:02 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:02 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf" returned: 0 in 0.251s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-784923e0-1893-472e-9973-754592542ebf" released by "_copy_volume_from_snapshot" :: held 7.390s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-8bffa7b3-3278-40c3-a116-9b98d5e08106-784923e0-1893-472e-9973-754592542ebf" released by "_create_volume_from_snapshot" :: held 7.460s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.488s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.081s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-dd585a7d-e718-4096-8157-81a32becc52c-08793add-2b66-4b5d-a68d-34d4d4d5969b" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-dd585a7d-e718-4096-8157-81a32becc52c-08793add-2b66-4b5d-a68d-34d4d4d5969b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Creating volume 08793add-2b66-4b5d-a68d-34d4d4d5969b from snapshot dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-08793add-2b66-4b5d-a68d-34d4d4d5969b" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08793add-2b66-4b5d-a68d-34d4d4d5969b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] snapshot: dd585a7d-e718-4096-8157-81a32becc52c, volume: 08793add-2b66-4b5d-a68d-34d4d4d5969b, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4092a-e289-4908-bf8d-f98e217e80d8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b0fca03a-c870-4cc0-8eb8-0f61c4d74a2a tempest-GroupSnapshotsTest-369984384 None] Create group from source-snapshot-f218d7e0-3ec3-49a8-9e3b-aad4d4191d87 completed successfully. Jul 28 16:28:02 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c Jul 28 16:28:02 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:03 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c" returned: 0 in 0.348s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc1f7c4-bde5-4a04-bc25-8190370ed231]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:03 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe Jul 28 16:28:03 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:03 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" returned: 0 in 0.404s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:03 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b Jul 28 16:28:03 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-784923e0-1893-472e-9973-754592542ebf" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-784923e0-1893-472e-9973-754592542ebf" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf70120-68a7-40c9-8cc6-a2c2164708a1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:04 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf Jul 28 16:28:04 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:04 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf" returned: 0 in 1.044s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:05 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf Jul 28 16:28:05 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:05 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-784923e0-1893-472e-9973-754592542ebf" returned: 0 in 0.781s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-784923e0-1893-472e-9973-754592542ebf" released by "delete_volume" :: held 1.903s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Created reservations ['c14d1996-77a0-4d58-a199-4625054feb0b'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:06 devstack cinder-volume[88286]: WARNING cinder.quota [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-786669636 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-786669636, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:28:06 devstack cinder-volume[88286]: WARNING cinder.quota [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-786669636 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-786669636, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Created reservations ['6d4e21d1-6c0f-488a-81cd-43d647819d8b', '1a33bfd9-4597-4fe4-b870-cd6d52d08a7a', '2a5fc426-f1e4-4f6b-bc9e-cffead614ca4', 'cafcd15c-c6f0-40c7-a65d-37793b99bc63'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:06 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:06 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:06 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] group_snapshot f218d7e0-3ec3-49a8-9e3b-aad4d4191d87: deleting Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] group_snapshot f218d7e0-3ec3-49a8-9e3b-aad4d4191d87: deleting {{(pid=88286) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-8bffa7b3-3278-40c3-a116-9b98d5e08106" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-8bffa7b3-3278-40c3-a116-9b98d5e08106" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Deleting offline snapshot 8bffa7b3-3278-40c3-a116-9b98d5e08106 of volume 144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:28:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] snapshot_file for this snap is: volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ce677-8a09-4478-b8d8-8597945221d7]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:07 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.787s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fcd2a4c3-5df0-4a9f-a612-fa1c710da35f tempest-GroupSnapshotsTest-369984384 None] Delete group completed successfully. Jul 28 16:28:07 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 Jul 28 16:28:07 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:07 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106" returned: 0 in 0.657s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7598be3-6f53-4892-a82b-9dc021ca65ac]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:08 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc Jul 28 16:28:08 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:08 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" returned: 0 in 0.728s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:08 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 Jul 28 16:28:08 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:08 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b" returned: 0 in 5.188s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:08 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc9b253-06bc-4d8d-8ab2-ea5d78c4f2e6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:08 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe Jul 28 16:28:08 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:08 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:08 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106 Jul 28 16:28:08 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:09 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc.8bffa7b3-3278-40c3-a116-9b98d5e08106" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-8bffa7b3-3278-40c3-a116-9b98d5e08106" released by "_delete_snapshot" :: held 2.303s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" released by "delete_snapshot" :: held 2.348s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:09 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" returned: 0 in 0.572s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:28:09 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Converted 1024.00 MB image at 197.32 MB/s Jul 28 16:28:09 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b is being set with open permissions: ugo+rw Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:09 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b Jul 28 16:28:09 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:09 devstack cinder-volume[88286]: WARNING cinder.quota [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-786669636 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-786669636, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['13eec304-a8b7-4633-8772-5ed01d8aef5c', 'aaaf2954-47d1-4e13-98ad-7bc0480ae854', 'd14365f5-57b6-4f79-bcb9-0332476ea31e', '32144c47-6c8f-43cf-8c2d-317596e58b8a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6d7df9bf-411d-4225-b7ba-eb03f0c95336 tempest-GroupSnapshotsTest-369984384 None] group_snapshot f218d7e0-3ec3-49a8-9e3b-aad4d4191d87: deleted successfully Jul 28 16:28:09 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b" returned: 0 in 0.264s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08793add-2b66-4b5d-a68d-34d4d4d5969b" released by "_copy_volume_from_snapshot" :: held 6.875s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-dd585a7d-e718-4096-8157-81a32becc52c-08793add-2b66-4b5d-a68d-34d4d4d5969b" released by "_create_volume_from_snapshot" :: held 6.906s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.924s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.163s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1167818844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a099aa3-0f93-4de5-a16f-6767cc9b630a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcffc504e0644fe8bcbb42896c7281f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:01Z,use_quota=True,user_id='86b9d1b9cdde45a3a2dc3178612db5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Creating volume 8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:28:09 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:09 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a 1073741824 Jul 28 16:28:09 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560f2133-ff87-48a5-82d3-38ec5d32f90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08793add-2b66-4b5d-a68d-34d4d4d5969b', 'volume_size': 1, 'snapshot_id': 'dd585a7d-e718-4096-8157-81a32becc52c'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96da01c-092f-4b7c-90f5-15d7f5a2e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:09 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Volume volume-08793add-2b66-4b5d-a68d-34d4d4d5969b (08793add-2b66-4b5d-a68d-34d4d4d5969b): created successfully Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96da01c-092f-4b7c-90f5-15d7f5a2e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Flow 'volume_create_manager' (a5c83bb9-eac0-4aa5-a045-fceb44ed60e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-47678cf3-d833-4c5f-88c3-9dc4a934891c tempest-VolumesDeleteCascade-2046809666 None] Created volume successfully. Jul 28 16:28:10 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a 1073741824" returned: 0 in 0.455s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:10 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:28:10 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:10 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.270s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817844d8-a40e-48a6-a2a5-e1b40f12a310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47cd89f-2af5-413f-9df0-41fd4699a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Volume volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a (8a099aa3-0f93-4de5-a16f-6767cc9b630a): created successfully Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47cd89f-2af5-413f-9df0-41fd4699a76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Flow 'volume_create_manager' (8173c4d6-c63d-4977-afae-7cf2bb133d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0d68a51b-f1ce-4ad0-93e3-fd6b12d31687 tempest-VolumesActionsTest-1368005194 None] Created volume successfully. Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8605e9-fbad-4f84-9f80-157c2955c709]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:10 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc Jul 28 16:28:10 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-08ece630-93a6-41c7-ac61-d23d8bc1a7fe-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-08ece630-93a6-41c7-ac61-d23d8bc1a7fe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Performing cascade delete. {{(pid=88286) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-dd585a7d-e718-4096-8157-81a32becc52c-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-dd585a7d-e718-4096-8157-81a32becc52c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-dd585a7d-e718-4096-8157-81a32becc52c" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-dd585a7d-e718-4096-8157-81a32becc52c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Deleting offline snapshot dd585a7d-e718-4096-8157-81a32becc52c of volume 08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:28:10 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] snapshot_file for this snap is: volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" returned: 0 in 0.415s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[962554f1-023e-4cab-8129-34fb7a7ae20e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:10 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc Jul 28 16:28:10 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:11 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c Jul 28 16:28:11 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:11 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-144f9a0e-9f02-4514-aa2e-b86d17e68dbc" released by "delete_volume" :: held 0.807s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['2639ca75-f354-41ca-9718-7381ce7afd05'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:11 devstack cinder-volume[88286]: WARNING cinder.db.api [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-786669636'] Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['ad7f7083-6dc4-4e18-b8bc-e5b00177f5b8', '88e85583-eff6-4012-ad6f-78423400e2ce', 'a642e633-a56c-4651-9615-d34c0863d66a', '743ecac3-21f7-494e-8ddd-55c22e9905eb'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:11 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c" returned: 0 in 0.441s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[00116af8-51bd-497b-9387-00d716e53095]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:11 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:11 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe Jul 28 16:28:11 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:11 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:11 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.355s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d7074eba-1ab3-434b-b697-f60cdd80e8a4 tempest-GroupSnapshotsTest-369984384 None] Delete group completed successfully. Jul 28 16:28:11 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" returned: 0 in 0.515s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:11 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c Jul 28 16:28:11 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-75ee5d65-84ae-4941-8889-57813429a61c tempest-GroupSnapshotsTest-369984384 None] Group tempest-GroupSnapshotsTest-Group-626836870: creating Jul 28 16:28:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-75ee5d65-84ae-4941-8889-57813429a61c tempest-GroupSnapshotsTest-369984384 None] Group tempest-GroupSnapshotsTest-Group-626836870: created successfully Jul 28 16:28:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-75ee5d65-84ae-4941-8889-57813429a61c tempest-GroupSnapshotsTest-369984384 None] Create group completed successfully. Jul 28 16:28:12 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c" returned: 0 in 0.469s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:12 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c Jul 28 16:28:12 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:12 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe.dd585a7d-e718-4096-8157-81a32becc52c" returned: 0 in 0.276s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-dd585a7d-e718-4096-8157-81a32becc52c" released by "_delete_snapshot" :: held 1.817s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" released by "delete_snapshot" :: held 1.847s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:12 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Created reservations ['f4d8135a-931c-469b-87e8-1eb5531f1cb3', '56145ede-22f0-4cf5-9f55-04a99ee688b9', '1c485d79-a038-4eb9-8740-eeedb1bbc014', '87be07e0-bcd9-478a-bc19-946365d739c4'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:13 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Delete snapshot completed successfully. Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-dd585a7d-e718-4096-8157-81a32becc52c-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Snapshots deleted, issuing volume delete {{(pid=88286) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8076c166-1397-43d3-ad46-35a1bb524c60]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:13 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe Jul 28 16:28:13 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:13 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" returned: 0 in 0.525s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:13 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe Jul 28 16:28:13 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:13 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" returned: 0 in 0.319s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08ece630-93a6-41c7-ac61-d23d8bc1a7fe" released by "delete_volume" :: held 0.958s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Created reservations ['07ffe7fc-4dc7-45f8-9a8b-ad0d14ceff23', '1b228496-2d47-4fc1-bad2-3c9e6ca30905', '66efb7db-19d4-46d3-baa2-a04417fa53d1', 'ca7a28d6-4df3-49d0-bc37-2adf9025c117'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (d9154283-1e7a-46db-a8a8-8aa2bbdac639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebca26aa-3891-40b4-ab50-e398fbfa3d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebca26aa-3891-40b4-ab50-e398fbfa3d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1576074421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6c595a3-48e7-409f-b91d-292a4b3d471e,host='devstack@QuobyteHD#QuobyteHD',id=6ac70db0-f63d-4fbd-a23c-7eef1fa40048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:14Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9362ad71-41ac-4625-833b-747669b07f70),volume_type_id=9362ad71-41ac-4625-833b-747669b07f70)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4887542-0ce1-4df2-98e1-f38ab727045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4887542-0ce1-4df2-98e1-f38ab727045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2370ae47-b8e3-4ce3-a3a2-64d547237331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2370ae47-b8e3-4ce3-a3a2-64d547237331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac70db0-f63d-4fbd-a23c-7eef1fa40048', 'volume_name': 'volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfd40a5-33e0-42d2-a1ae-fe4ae14372ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfd40a5-33e0-42d2-a1ae-fe4ae14372ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6f2b3-39c0-44ad-a9bf-6dcaecc1b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:14 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Volume 6ac70db0-f63d-4fbd-a23c-7eef1fa40048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048', 'volume_size': 1} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f6c595a3-48e7-409f-b91d-292a4b3d471e,created_at=2026-07-28T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1576074421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6c595a3-48e7-409f-b91d-292a4b3d471e,host='devstack@QuobyteHD#QuobyteHD',id=6ac70db0-f63d-4fbd-a23c-7eef1fa40048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:14Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9362ad71-41ac-4625-833b-747669b07f70),volume_type_id=9362ad71-41ac-4625-833b-747669b07f70)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Creating volume 6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:28:14 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:14 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 1073741824 Jul 28 16:28:14 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:14 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:14 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:14 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.376s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Deleted volume successfully. Jul 28 16:28:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b40fc6-9ab3-42d1-9f48-b9e5e3fdbf8f tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-08ece630-93a6-41c7-ac61-d23d8bc1a7fe-delete_volume" released by "delete_volume" :: held 4.130s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:15 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 1073741824" returned: 0 in 0.691s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:15 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 Jul 28 16:28:15 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-08793add-2b66-4b5d-a68d-34d4d4d5969b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-08793add-2b66-4b5d-a68d-34d4d4d5969b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "cinder-quobyte-08793add-2b66-4b5d-a68d-34d4d4d5969b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:15 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" returned: 0 in 0.342s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6f2b3-39c0-44ad-a9bf-6dcaecc1b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784686a1-118d-484c-9b11-d3334acf4ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08793add-2b66-4b5d-a68d-34d4d4d5969b" acquired by "delete_volume" :: waited 0.044s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Volume volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 (6ac70db0-f63d-4fbd-a23c-7eef1fa40048): created successfully Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784686a1-118d-484c-9b11-d3334acf4ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (d9154283-1e7a-46db-a8a8-8aa2bbdac639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4760be13-a218-4482-9697-805729369bfd]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-aa66e40f-d8a1-4e2c-abed-46c4c7e948d7 tempest-GroupSnapshotsTest-369984384 None] Created volume successfully. Jul 28 16:28:15 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b Jul 28 16:28:15 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:16 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b" returned: 0 in 0.450s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:16 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b Jul 28 16:28:16 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:16 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-08793add-2b66-4b5d-a68d-34d4d4d5969b" returned: 0 in 0.314s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-quobyte-08793add-2b66-4b5d-a68d-34d4d4d5969b" released by "delete_volume" :: held 0.830s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Created reservations ['f1613901-68c2-4612-8b23-87b91a5a4421', 'aed0f523-d474-42c0-a796-28f8f6bd4a95', '8aac553f-3ea6-4c25-ad45-849c292ea2fc', '0ba0126a-af6a-4683-9fb4-5a94f01657ff'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:16 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:16 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:16 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.372s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:16 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:16 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Deleted volume successfully. Jul 28 16:28:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-45a3f13d-a909-4cfd-9020-2501dc868884 tempest-VolumesDeleteCascade-2046809666 None] Lock "cinder-08793add-2b66-4b5d-a68d-34d4d4d5969b-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (d64e6b50-6f96-40d3-bf2f-6bf075dca952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8b8433-d18c-4d86-a518-771ba8c4fa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8b8433-d18c-4d86-a518-771ba8c4fa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1527992935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6c595a3-48e7-409f-b91d-292a4b3d471e,host='devstack@QuobyteHD#QuobyteHD',id=1325afa6-145d-47e9-8c72-b48f18909122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:18Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9362ad71-41ac-4625-833b-747669b07f70),volume_type_id=9362ad71-41ac-4625-833b-747669b07f70)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b3692c-a76a-406e-aaa8-1130f9db3095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b3692c-a76a-406e-aaa8-1130f9db3095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35658825-703c-4d86-9d7e-0b010b2c9cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35658825-703c-4d86-9d7e-0b010b2c9cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1325afa6-145d-47e9-8c72-b48f18909122', 'volume_name': 'volume-1325afa6-145d-47e9-8c72-b48f18909122', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcd3a00-323f-465e-a29a-49477871b586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcd3a00-323f-465e-a29a-49477871b586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bd6717-62ed-4477-8847-09eeec637be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:18 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Volume 1325afa6-145d-47e9-8c72-b48f18909122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1325afa6-145d-47e9-8c72-b48f18909122', 'volume_size': 1} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f6c595a3-48e7-409f-b91d-292a4b3d471e,created_at=2026-07-28T14:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1527992935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6c595a3-48e7-409f-b91d-292a4b3d471e,host='devstack@QuobyteHD#QuobyteHD',id=1325afa6-145d-47e9-8c72-b48f18909122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:18Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9362ad71-41ac-4625-833b-747669b07f70),volume_type_id=9362ad71-41ac-4625-833b-747669b07f70)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Creating volume 1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:28:18 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:28:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:18 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 1073741824 Jul 28 16:28:18 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:19 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 1073741824" returned: 0 in 0.672s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:19 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 Jul 28 16:28:19 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:19 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bd6717-62ed-4477-8847-09eeec637be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1325afa6-145d-47e9-8c72-b48f18909122', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2e14de-aef1-4e86-adda-15dce8994c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:19 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Volume volume-1325afa6-145d-47e9-8c72-b48f18909122 (1325afa6-145d-47e9-8c72-b48f18909122): created successfully Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2e14de-aef1-4e86-adda-15dce8994c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (d64e6b50-6f96-40d3-bf2f-6bf075dca952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:19 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b6cfb513-d0fa-4dd7-bbe5-75f9237fa2f3 tempest-GroupSnapshotsTest-369984384 None] Created volume successfully. Jul 28 16:28:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-93562ae2-c3ce-4b35-840a-efaff6c8098a tempest-GroupSnapshotsTest-369984384 None] Update group completed successfully. Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcfd1b58-b4af-446b-919f-0dfffa76ca14 tempest-VolumesActionsTest-1368005194 None] Acquiring lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a" by "attach_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcfd1b58-b4af-446b-919f-0dfffa76ca14 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a" acquired by "attach_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-bcfd1b58-b4af-446b-919f-0dfffa76ca14 tempest-VolumesActionsTest-1368005194 None] Attaching volume 8a099aa3-0f93-4de5-a16f-6767cc9b630a to instance db0d4742-ad56-4bce-bc5b-9e0ce54aa380 at mountpoint /dev/vdb on host None. Jul 28 16:28:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-bcfd1b58-b4af-446b-919f-0dfffa76ca14 tempest-VolumesActionsTest-1368005194 None] Attach volume completed successfully. Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcfd1b58-b4af-446b-919f-0dfffa76ca14 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a" released by "attach_volume" :: held 0.143s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-abbdfcb5-7c6e-4187-9274-d1797ead9bc9 tempest-VolumesActionsTest-1368005194 None] Acquiring lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-detach_volume" by "detach_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Flow 'volume_create_manager' (726c1f93-e0f7-416d-bc11-80d829891913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87816f0-700a-437c-ac9e-a186886ed601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-abbdfcb5-7c6e-4187-9274-d1797ead9bc9 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-abbdfcb5-7c6e-4187-9274-d1797ead9bc9 tempest-VolumesActionsTest-1368005194 None] Detaching volume 8a099aa3-0f93-4de5-a16f-6767cc9b630a from instance db0d4742-ad56-4bce-bc5b-9e0ce54aa380. Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87816f0-700a-437c-ac9e-a186886ed601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1881668749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5928ab6e-0e1c-4454-8bb5-bde678d86340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2970f0f034db4ec58e2bb5b3a75e30f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:21Z,use_quota=True,user_id='960f35fc9d644d7db34bcf53f02da613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbafe42-db2a-4eaf-933c-11814389f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbafe42-db2a-4eaf-933c-11814389f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86af5fa1-640a-4573-a2b0-6c71413cb52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86af5fa1-640a-4573-a2b0-6c71413cb52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5928ab6e-0e1c-4454-8bb5-bde678d86340', 'volume_name': 'volume-5928ab6e-0e1c-4454-8bb5-bde678d86340', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c1f2c7-4e89-49cd-955c-b28381773033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c1f2c7-4e89-49cd-955c-b28381773033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38f7e97-7079-4e3f-a870-5105bc0bb234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:21 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Volume 5928ab6e-0e1c-4454-8bb5-bde678d86340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5928ab6e-0e1c-4454-8bb5-bde678d86340', 'volume_size': 1} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1881668749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5928ab6e-0e1c-4454-8bb5-bde678d86340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2970f0f034db4ec58e2bb5b3a75e30f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:21Z,use_quota=True,user_id='960f35fc9d644d7db34bcf53f02da613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Creating volume 5928ab6e-0e1c-4454-8bb5-bde678d86340 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:28:21 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:21 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 1073741824 Jul 28 16:28:21 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-abbdfcb5-7c6e-4187-9274-d1797ead9bc9 tempest-VolumesActionsTest-1368005194 None] Detach volume completed successfully. Jul 28 16:28:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-abbdfcb5-7c6e-4187-9274-d1797ead9bc9 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-detach_volume" released by "detach_volume" :: held 0.144s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-25f8712c-7403-4e72-9a0e-adcdeba78e3d tempest-GroupSnapshotsTest-369984384 None] Update group completed successfully. Jul 28 16:28:22 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 1073741824" returned: 0 in 0.688s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:22 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 Jul 28 16:28:22 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:22 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340" returned: 0 in 0.333s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38f7e97-7079-4e3f-a870-5105bc0bb234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5928ab6e-0e1c-4454-8bb5-bde678d86340', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d41a8d-918c-4ec1-a6e7-a75d663a18d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:22 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Volume volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 (5928ab6e-0e1c-4454-8bb5-bde678d86340): created successfully Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d41a8d-918c-4ec1-a6e7-a75d663a18d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Flow 'volume_create_manager' (726c1f93-e0f7-416d-bc11-80d829891913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3036642e-649b-4724-a066-25d7414db7a8 tempest-VolumesMetadataTest-1722296766 None] Created volume successfully. Jul 28 16:28:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cfe783da-64c8-40ca-961c-5743ff019e4e tempest-GroupSnapshotsTest-369984384 None] Update group completed successfully. Jul 28 16:28:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Acquiring lock "cinder-5928ab6e-0e1c-4454-8bb5-bde678d86340-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Lock "cinder-5928ab6e-0e1c-4454-8bb5-bde678d86340-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b6b05752-aa23-49a8-b8a4-917a79c8b11b tempest-GroupSnapshotsTest-369984384 None] Update group completed successfully. Jul 28 16:28:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Acquiring lock "cinder-quobyte-5928ab6e-0e1c-4454-8bb5-bde678d86340" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Lock "cinder-quobyte-5928ab6e-0e1c-4454-8bb5-bde678d86340" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf464b-ae30-4c94-94a3-e983c638d62d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:24 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 Jul 28 16:28:24 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:25 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340" returned: 0 in 0.408s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:25 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340 Jul 28 16:28:25 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:25 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5928ab6e-0e1c-4454-8bb5-bde678d86340" returned: 0 in 0.257s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Lock "cinder-quobyte-5928ab6e-0e1c-4454-8bb5-bde678d86340" released by "delete_volume" :: held 0.711s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Created reservations ['30ac60d1-c592-4259-9799-a294cd528607', 'c34c9b28-b665-40fa-be56-99a0f6999f40', '7f5be01c-2a86-4489-b61c-96e1f4e3bc6b', '928277e5-8563-4995-bca6-6ffffc626a3e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:25 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:25 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:25 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.338s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Deleted volume successfully. Jul 28 16:28:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d0f30380-89cf-4f60-92f0-b3b13716c89d tempest-VolumesMetadataTest-1722296766 None] Lock "cinder-5928ab6e-0e1c-4454-8bb5-bde678d86340-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] GroupSnapshot 3ac07be4-e3ba-41ca-82ae-e02c72afd7d0: creating. Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Group snapshot 3ac07be4-e3ba-41ca-82ae-e02c72afd7d0: creating. {{(pid=88286) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Creating offline snapshot 444bb349-8aa4-47a2-a4dc-de402fed27d7 of volume 6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1e6a16-c5da-4896-a1f3-67d7b0a5e7f8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:26 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 Jul 28 16:28:26 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:26 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" returned: 0 in 0.471s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:26 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 1G Jul 28 16:28:26 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:27 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 1G" returned: 0 in 0.577s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:27 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 Jul 28 16:28:27 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:27 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7" returned: 0 in 0.400s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:27 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:28:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:27 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 Jul 28 16:28:27 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:28 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7" returned: 0 in 0.484s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:28 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.info Jul 28 16:28:28 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:28 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.info" returned: 0 in 0.285s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:28 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:28 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.info Jul 28 16:28:28 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:28 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.info" returned: 0 in 0.252s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Creating offline snapshot fbfb15b9-531c-4dd7-bc1c-801c07447658 of volume 1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9d0caf-e9be-44e0-9133-049bfeae564b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:29 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 Jul 28 16:28:29 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:29 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122" returned: 0 in 0.460s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:29 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 1G Jul 28 16:28:29 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:29 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 1G" returned: 0 in 0.530s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1325afa6-145d-47e9-8c72-b48f18909122 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:29 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1325afa6-145d-47e9-8c72-b48f18909122 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 Jul 28 16:28:29 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:30 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1325afa6-145d-47e9-8c72-b48f18909122 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658" returned: 0 in 0.541s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:30 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:28:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:30 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 Jul 28 16:28:30 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:30 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658" returned: 0 in 0.391s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:30 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.info Jul 28 16:28:30 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:31 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.info" returned: 0 in 0.417s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:31 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:28:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:31 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.info Jul 28 16:28:31 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:31 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.info" returned: 0 in 0.339s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.827s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:31 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f9575c0f-4704-4d8d-aedd-077a0d54390a tempest-GroupSnapshotsTest-369984384 None] group_snapshot 3ac07be4-e3ba-41ca-82ae-e02c72afd7d0: created successfully Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Flow 'volume_create_manager' (b4eda17c-6495-4bd3-ac4c-dcc53b51b092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252fca8d-9028-4730-9596-7e20962cd0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252fca8d-9028-4730-9596-7e20962cd0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1146635548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469f6722-be4d-4da8-9e3f-eb2a1d17607e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac43767290462aa7443971ab64164a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:32Z,use_quota=True,user_id='2dc8a52fd75a41f0a8cfd70cab530b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f672a-676a-4284-8b11-211e7de30c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f672a-676a-4284-8b11-211e7de30c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e72577-eb27-48fe-a199-38aa9ad1ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e72577-eb27-48fe-a199-38aa9ad1ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469f6722-be4d-4da8-9e3f-eb2a1d17607e', 'volume_name': 'volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2581b4-22de-4624-9b7c-0173f0720c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2581b4-22de-4624-9b7c-0173f0720c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4150e4e0-f159-4b02-80fb-1eaf8861f9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:32 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Volume 469f6722-be4d-4da8-9e3f-eb2a1d17607e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e', 'volume_size': 1} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1146635548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469f6722-be4d-4da8-9e3f-eb2a1d17607e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac43767290462aa7443971ab64164a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:32Z,use_quota=True,user_id='2dc8a52fd75a41f0a8cfd70cab530b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Creating volume 469f6722-be4d-4da8-9e3f-eb2a1d17607e {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:28:32 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:32 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e 1073741824 Jul 28 16:28:32 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] group_snapshot 3ac07be4-e3ba-41ca-82ae-e02c72afd7d0: deleting Jul 28 16:28:32 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] group_snapshot 3ac07be4-e3ba-41ca-82ae-e02c72afd7d0: deleting {{(pid=88286) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-444bb349-8aa4-47a2-a4dc-de402fed27d7" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-444bb349-8aa4-47a2-a4dc-de402fed27d7" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Deleting offline snapshot 444bb349-8aa4-47a2-a4dc-de402fed27d7 of volume 6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] snapshot_file for this snap is: volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37db130-d524-4988-917f-482ef58eb2f5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:33 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 Jul 28 16:28:33 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:33 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e 1073741824" returned: 0 in 0.952s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:33 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e Jul 28 16:28:33 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:33 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7" returned: 0 in 0.786s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[915fcb94-35b3-47d6-9296-80cbf86fe57b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:34 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e" returned: 0 in 0.559s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4150e4e0-f159-4b02-80fb-1eaf8861f9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0457f68b-5fe6-43d8-8b1f-bdf7c9faed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:34 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Volume volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e (469f6722-be4d-4da8-9e3f-eb2a1d17607e): created successfully Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0457f68b-5fe6-43d8-8b1f-bdf7c9faed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Flow 'volume_create_manager' (b4eda17c-6495-4bd3-ac4c-dcc53b51b092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:34 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3b217fee-7f5e-44e9-857a-2fb86349b8f3 tempest-VolumesTransfersV357Test-517797512 None] Created volume successfully. Jul 28 16:28:34 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 Jul 28 16:28:34 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:34 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" returned: 0 in 0.545s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:34 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 Jul 28 16:28:34 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:35 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7" returned: 0 in 0.443s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:35 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7 Jul 28 16:28:35 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:35 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048.444bb349-8aa4-47a2-a4dc-de402fed27d7" returned: 0 in 0.428s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3af2ea3a-2a58-4a33-a779-7afa53df027a tempest-VolumesTransfersV357Test-1156696477 None] Transfer volume completed successfully. Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-444bb349-8aa4-47a2-a4dc-de402fed27d7" released by "_delete_snapshot" :: held 2.443s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" released by "delete_snapshot" :: held 2.509s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-1325afa6-145d-47e9-8c72-b48f18909122" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8fd5ead6-ead6-4890-9133-743102f27521 tempest-VolumesActionsTest-1368005194 None] Acquiring lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a" by "attach_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-1325afa6-145d-47e9-8c72-b48f18909122" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-fbfb15b9-531c-4dd7-bc1c-801c07447658" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-fbfb15b9-531c-4dd7-bc1c-801c07447658" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Deleting offline snapshot fbfb15b9-531c-4dd7-bc1c-801c07447658 of volume 1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] snapshot_file for this snap is: volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8fd5ead6-ead6-4890-9133-743102f27521 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a" acquired by "attach_volume" :: waited 0.078s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d73168-e977-4627-a740-fd1ade9a292e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8fd5ead6-ead6-4890-9133-743102f27521 tempest-VolumesActionsTest-1368005194 None] Attaching volume 8a099aa3-0f93-4de5-a16f-6767cc9b630a to instance 0869d495-f461-4eb0-a078-a40dd0db6571 at mountpoint /dev/vdb on host None. Jul 28 16:28:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8fd5ead6-ead6-4890-9133-743102f27521 tempest-VolumesActionsTest-1368005194 None] Attach volume completed successfully. Jul 28 16:28:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8fd5ead6-ead6-4890-9133-743102f27521 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a" released by "attach_volume" :: held 0.206s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:35 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 Jul 28 16:28:35 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Acquiring lock "cinder-469f6722-be4d-4da8-9e3f-eb2a1d17607e-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-469f6722-be4d-4da8-9e3f-eb2a1d17607e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-075df32b-77d1-44bd-819f-c6edb4c7cd17 tempest-VolumesActionsTest-1368005194 None] Acquiring lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-detach_volume" by "detach_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-075df32b-77d1-44bd-819f-c6edb4c7cd17 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-075df32b-77d1-44bd-819f-c6edb4c7cd17 tempest-VolumesActionsTest-1368005194 None] Detaching volume 8a099aa3-0f93-4de5-a16f-6767cc9b630a from instance 0869d495-f461-4eb0-a078-a40dd0db6571. Jul 28 16:28:36 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658" returned: 0 in 0.654s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1325afa6-145d-47e9-8c72-b48f18909122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Acquiring lock "cinder-quobyte-469f6722-be4d-4da8-9e3f-eb2a1d17607e" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b11f8a1-8394-46bb-ab02-ac3aa7d3064e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-quobyte-469f6722-be4d-4da8-9e3f-eb2a1d17607e" acquired by "delete_volume" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[78da4cfb-e834-4ad4-aa81-a1e81096e074]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-075df32b-77d1-44bd-819f-c6edb4c7cd17 tempest-VolumesActionsTest-1368005194 None] Detach volume completed successfully. Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-075df32b-77d1-44bd-819f-c6edb4c7cd17 tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-detach_volume" released by "detach_volume" :: held 0.162s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:36 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 Jul 28 16:28:36 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:36 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e Jul 28 16:28:36 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:36 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122" returned: 0 in 0.562s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:36 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 Jul 28 16:28:36 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:36 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e" returned: 0 in 0.553s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:37 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e Jul 28 16:28:37 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:37 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-469f6722-be4d-4da8-9e3f-eb2a1d17607e" returned: 0 in 0.340s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-quobyte-469f6722-be4d-4da8-9e3f-eb2a1d17607e" released by "delete_volume" :: held 0.984s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:37 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658" returned: 0 in 0.574s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Created reservations ['30fd07c3-c993-413c-a80e-0e34f33d6bf0', 'b8de5b0f-4341-45bc-bad6-29b5e8907c79', '0cc1f816-9e5c-40a0-896c-5ae7bc4decf4', '3472c9f6-a4c9-41a7-b7db-95c7c7711c2c'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:37 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658 Jul 28 16:28:37 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:37 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:37 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:37 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122.fbfb15b9-531c-4dd7-bc1c-801c07447658" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-fbfb15b9-531c-4dd7-bc1c-801c07447658" released by "_delete_snapshot" :: held 2.248s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-1325afa6-145d-47e9-8c72-b48f18909122" released by "delete_snapshot" :: held 2.288s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:37 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Deleted volume successfully. Jul 28 16:28:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ae28b1a9-2103-4756-905c-d66a90ea0857 tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-469f6722-be4d-4da8-9e3f-eb2a1d17607e-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:37 devstack cinder-volume[88286]: WARNING cinder.quota [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1408893094 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1408893094, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:28:37 devstack cinder-volume[88286]: WARNING cinder.quota [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1408893094 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1408893094, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:28:38 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['d03c3ba2-34d3-4235-9eb6-d3266834e880', '18bac93e-df89-4f6b-9dc3-714897bd4c84', 'a301ffa0-e9ea-4892-ba82-91a3f731e974', 'f0e4239d-6d04-4538-b2b2-c52418ee40ec'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:38 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['bbd04559-823d-4799-bb02-bd22c0ce7f24', '10e968b2-143b-448f-a1dc-031c3e47a72b', '669a1fe2-6b68-4c74-87e0-191d9391685d', 'd5bb91ad-cd94-407e-8a52-59a4b036643a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:38 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5e630c9e-c219-4191-830d-31720ddfbbc3 tempest-GroupSnapshotsTest-369984384 None] group_snapshot 3ac07be4-e3ba-41ca-82ae-e02c72afd7d0: deleted successfully Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Flow 'volume_create_manager' (7cccdd0c-725a-4584-8481-679a70030636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102fbe87-c5cc-4e40-acda-d38916a5a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102fbe87-c5cc-4e40-acda-d38916a5a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-453871222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2943d23-cffe-40e5-a19c-ee24e4ffa27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac43767290462aa7443971ab64164a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:39Z,use_quota=True,user_id='2dc8a52fd75a41f0a8cfd70cab530b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0f784a-4259-4070-9bdb-f8aed9b0d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0f784a-4259-4070-9bdb-f8aed9b0d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaa1a7a-5a59-4c64-9316-f1936fc9b0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaa1a7a-5a59-4c64-9316-f1936fc9b0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2943d23-cffe-40e5-a19c-ee24e4ffa27e', 'volume_name': 'volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48fd4ef-2861-46ca-b5ba-06f09bc3a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48fd4ef-2861-46ca-b5ba-06f09bc3a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9746a28e-09d9-440d-b8dc-a25cd5fbd881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:39 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Volume b2943d23-cffe-40e5-a19c-ee24e4ffa27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e', 'volume_size': 1} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-453871222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2943d23-cffe-40e5-a19c-ee24e4ffa27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac43767290462aa7443971ab64164a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:39Z,use_quota=True,user_id='2dc8a52fd75a41f0a8cfd70cab530b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Creating volume b2943d23-cffe-40e5-a19c-ee24e4ffa27e {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:28:39 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:39 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e 1073741824 Jul 28 16:28:39 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-1325afa6-145d-47e9-8c72-b48f18909122" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-1325afa6-145d-47e9-8c72-b48f18909122" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34e3f7-5d7e-44cd-a5e9-b8a31e2962b9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:39 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 Jul 28 16:28:39 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:39 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e 1073741824" returned: 0 in 0.536s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:39 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e Jul 28 16:28:39 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:39 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122" returned: 0 in 0.486s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:39 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122 Jul 28 16:28:39 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:40 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e" returned: 0 in 0.306s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9746a28e-09d9-440d-b8dc-a25cd5fbd881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a94251-a35e-43a5-a500-35531a5f6183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:40 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1325afa6-145d-47e9-8c72-b48f18909122" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:40 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Volume volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e (b2943d23-cffe-40e5-a19c-ee24e4ffa27e): created successfully Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a94251-a35e-43a5-a500-35531a5f6183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Flow 'volume_create_manager' (7cccdd0c-725a-4584-8481-679a70030636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-1325afa6-145d-47e9-8c72-b48f18909122" released by "delete_volume" :: held 0.895s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:40 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9026b4c7-3e50-4aa0-ad11-80bda84c6940 tempest-VolumesTransfersV357Test-517797512 None] Created volume successfully. Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf2f5a-705c-4ede-be5c-7aada0fb0bc1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:40 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 Jul 28 16:28:40 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:40 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" returned: 0 in 0.401s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:40 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048 Jul 28 16:28:40 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:41 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" returned: 0 in 0.293s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-6ac70db0-f63d-4fbd-a23c-7eef1fa40048" released by "delete_volume" :: held 0.776s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:41 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:41 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['1a76407c-88b4-4126-a382-2e97aaba1802'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:41 devstack cinder-volume[88286]: WARNING cinder.quota [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1408893094 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1408893094, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['5baeb4a4-70c0-480b-9a40-c6892df484c9', 'c6fe99dc-245d-4d27-9457-c14a8aadaf91', 'd8fda03e-7b82-41d5-a084-585c3d90c577', '3f710d00-7026-4fd3-988b-533351af2fe7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=151,cinder:INSERT=37,cinder:UPDATE=145,cinder:DELETE=9 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['26f0bc62-506f-4613-bc4d-52cf614110fe', 'a5d6611e-a491-48ef-ad71-b84743242de1', 'bd5bb0fe-08e1-4dcf-9e22-85f4230f693f', '163c0b6f-68db-4d13-ae99-f4c6e4010444'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:41 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.381s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 8 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b55ed8-97cf-49c4-ab31-45d696707c87]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:41 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:41 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:41 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:28:41 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Acquiring lock "cinder-b2943d23-cffe-40e5-a19c-ee24e4ffa27e-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-b2943d23-cffe-40e5-a19c-ee24e4ffa27e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Acquiring lock "cinder-quobyte-b2943d23-cffe-40e5-a19c-ee24e4ffa27e" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-quobyte-b2943d23-cffe-40e5-a19c-ee24e4ffa27e" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:28:41 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.330s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:41 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d6b722a8-9962-4543-9db2-fffa2ce14b65 tempest-GroupSnapshotsTest-369984384 None] Delete group completed successfully. Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df78f3-99aa-47e3-a22c-266bfb9f6d29]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:42 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e Jul 28 16:28:42 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:42 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.537s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[28be6c58-21c3-4a5e-a733-34248b232da2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-95287db0-84d3-4044-bbdc-9cc1aa2d2347 tempest-GroupSnapshotsTest-369984384 None] Group tempest-GroupSnapshotsTest-Group-614159458: creating Jul 28 16:28:42 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:28:42 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-95287db0-84d3-4044-bbdc-9cc1aa2d2347 tempest-GroupSnapshotsTest-369984384 None] Group tempest-GroupSnapshotsTest-Group-614159458: created successfully Jul 28 16:28:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-95287db0-84d3-4044-bbdc-9cc1aa2d2347 tempest-GroupSnapshotsTest-369984384 None] Create group completed successfully. Jul 28 16:28:42 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e" returned: 0 in 0.407s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:42 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e Jul 28 16:28:42 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:42 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.394s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.46b73386-ff55-46cf-8aee-73279848df38u0wtssfn.img {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:42 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.46b73386-ff55-46cf-8aee-73279848df38u0wtssfn.img Jul 28 16:28:42 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:42 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b2943d23-cffe-40e5-a19c-ee24e4ffa27e" returned: 0 in 0.266s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-quobyte-b2943d23-cffe-40e5-a19c-ee24e4ffa27e" released by "delete_volume" :: held 0.737s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Created reservations ['7a1717d5-22d5-4044-96f5-fffe81e20d34', 'ac2a34bb-305e-4fb3-9196-5cd6eb7f4838', '41adc380-2690-44b3-920c-1aa3930a5963', '0bf2dc90-27b3-463e-b163-a7dbcdac1ed2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:28:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:42 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:28:42 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:43 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.617s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:43 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:28:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Deleted volume successfully. Jul 28 16:28:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-851546a2-65c6-447f-a95d-c5d653dff3ca tempest-VolumesTransfersV357Test-515995784 None] Lock "cinder-b2943d23-cffe-40e5-a19c-ee24e4ffa27e-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=180,cinder:SELECT=159,cinder:INSERT=41,cinder:DELETE=7 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (f768cea8-7b92-4857-9cda-be07707f28fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb503cdb-47f4-4af0-8278-b6cfb7943571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb503cdb-47f4-4af0-8278-b6cfb7943571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207294684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63718d15-f872-4af5-bc34-72874d731cd0,host='devstack@QuobyteHD#QuobyteHD',id=ea3f25e4-8031-4e47-a8fc-7ad752abbe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:44Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7b70247-0f92-4efa-aee3-9b1e7cd1ca30),volume_type_id=b7b70247-0f92-4efa-aee3-9b1e7cd1ca30)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14dee7-b6fb-40d2-ac17-d843eddb25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14dee7-b6fb-40d2-ac17-d843eddb25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34da3dd9-018c-4bec-b37e-1030a221ea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34da3dd9-018c-4bec-b37e-1030a221ea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3f25e4-8031-4e47-a8fc-7ad752abbe77', 'volume_name': 'volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea76499-9fc3-4a0e-a5fb-4efe629af99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea76499-9fc3-4a0e-a5fb-4efe629af99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd862f8-8a74-494d-a77e-0d344239c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Volume ea3f25e4-8031-4e47-a8fc-7ad752abbe77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77', 'volume_size': 1} Jul 28 16:28:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:28:47 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.46b73386-ff55-46cf-8aee-73279848df38u0wtssfn.img" returned: 0 in 5.099s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:47 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae48e44c-a1c4-43fe-a4ae-cfab137e336b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:47 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:28:47 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:48 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.548s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:48 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.46b73386-ff55-46cf-8aee-73279848df38u0wtssfn.img {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:28:48 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Converted 1024.00 MB image at 200.80 MB/s Jul 28 16:28:48 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] 46b73386-ff55-46cf-8aee-73279848df38 was raw, no need to convert to raw {{(pid=88286) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Flow 'volume_create_manager' (32321fc0-02bb-4043-95a3-c43847c4ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fbb90e-979a-4a36-bf83-fdaeb94621ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fbb90e-979a-4a36-bf83-fdaeb94621ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457725704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184b424b-7693-4f11-bb29-b9c8ffb49be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cef832d97a405e8750ba87c229c5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:53Z,use_quota=True,user_id='6cb95f539cc0441c8fdb56ed02cb2417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17f55ae-327f-4aba-a2bf-07b2988bbb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17f55ae-327f-4aba-a2bf-07b2988bbb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005dbc2b-fb83-4fec-8573-aaa755944238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:52 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005dbc2b-fb83-4fec-8573-aaa755944238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '184b424b-7693-4f11-bb29-b9c8ffb49be2', 'volume_name': 'volume-184b424b-7693-4f11-bb29-b9c8ffb49be2', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f43dce6-ade3-4b8f-818a-ee60a0a58ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f43dce6-ade3-4b8f-818a-ee60a0a58ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204bd42e-e949-4eb7-ac76-f86ba3a5b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:28:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Volume 184b424b-7693-4f11-bb29-b9c8ffb49be2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-184b424b-7693-4f11-bb29-b9c8ffb49be2', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Trying to clone 184b424b-7693-4f11-bb29-b9c8ffb49be2 from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:28:53 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Image download 20.69 MB at 20.69 MB/s Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9133c-e604-450d-9ba5-c409f9723b34]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:53 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD Jul 28 16:28:53 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:53 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 is fetched for user 6cb95f539cc0441c8fdb56ed02cb2417. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d99ac5-7a32-4bc0-9d42-478817b548c3]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:28:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:28:54 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD Jul 28 16:28:54 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:28:54 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 28 16:28:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:28:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:03 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=17 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:29:03 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=2,cinder:INSERT=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.261s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Uploaded volume to glance image-id: 46b73386-ff55-46cf-8aee-73279848df38. {{(pid=88286) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.265s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63718d15-f872-4af5-bc34-72874d731cd0,created_at=2026-07-28T14:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207294684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63718d15-f872-4af5-bc34-72874d731cd0,host='devstack@QuobyteHD#QuobyteHD',id=ea3f25e4-8031-4e47-a8fc-7ad752abbe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025d74be0e0742b0ba56fc2444eca401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:44Z,use_quota=True,user_id='93a972eec68d435ab75cda8eb6ea9c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7b70247-0f92-4efa-aee3-9b1e7cd1ca30),volume_type_id=b7b70247-0f92-4efa-aee3-9b1e7cd1ca30)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Creating volume ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:29:07 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:29:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:07 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 1073741824 Jul 28 16:29:07 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-12233603-660f-430d-9734-f9acc1eb6982 tempest-VolumesActionsTest-1368005194 None] Copy volume to image completed successfully. Jul 28 16:29:08 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 1073741824" returned: 0 in 0.461s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:08 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 Jul 28 16:29:08 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:08 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" returned: 0 in 0.285s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.336s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457725704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184b424b-7693-4f11-bb29-b9c8ffb49be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cef832d97a405e8750ba87c229c5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:28:53Z,use_quota=True,user_id='6cb95f539cc0441c8fdb56ed02cb2417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Creating volume 184b424b-7693-4f11-bb29-b9c8ffb49be2 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:29:08 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:08 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 1073741824 Jul 28 16:29:08 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd862f8-8a74-494d-a77e-0d344239c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b559d0-3ae9-4435-8778-d93c47fd6050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Volume volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 (ea3f25e4-8031-4e47-a8fc-7ad752abbe77): created successfully Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b559d0-3ae9-4435-8778-d93c47fd6050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Flow 'volume_create_manager' (f768cea8-7b92-4857-9cda-be07707f28fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ce5781ad-c07a-4e8a-9753-95fa568755f2 tempest-GroupSnapshotsTest-369984384 None] Created volume successfully. Jul 28 16:29:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:09 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 1073741824" returned: 0 in 0.447s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:09 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 Jul 28 16:29:09 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:09 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2" returned: 0 in 0.248s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.519s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e19c02-108e-487a-a8ce-716a7c1909aa]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Attempting download of 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume 184b424b-7693-4f11-bb29-b9c8ffb49be2. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017fcb6-9b22-4969-a434-af7650024508]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_21pgd9t4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:09 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:29:09 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:09 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_21pgd9t4 Jul 28 16:29:09 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:09 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.415s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950bc0e-ea40-41c0-b466-cdb02de868d4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:09 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_21pgd9t4" returned: 0 in 0.389s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_21pgd9t4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] GroupSnapshot 9d564b3d-8407-4d12-b948-42384f8a7e5f: creating. Jul 28 16:29:10 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_21pgd9t4 Jul 28 16:29:10 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Group snapshot 9d564b3d-8407-4d12-b948-42384f8a7e5f: creating. {{(pid=88286) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:10 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:29:10 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:10 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_21pgd9t4" returned: 1 in 0.380s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_21pgd9t4' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3e18d1-b0a7-40af-ac39-ecd17ae005cd]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:10 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.464s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:10 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img Jul 28 16:29:10 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:10 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD Jul 28 16:29:10 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:10 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] 80bdb979-36ce-4750-96f5-dc31bfd10d53 was qcow2, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:29:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:10 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 Jul 28 16:29:10 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:14 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2" returned: 0 in 3.710s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_64gufnuodevstack@QuobyteHD, size 112.00 MB, duration 3.71 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:29:14 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Converted 112.00 MB image at 30.17 MB/s Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:14 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 1G Jul 28 16:29:14 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:14 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 1G" returned: 0 in 0.557s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Downloaded image 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume 184b424b-7693-4f11-bb29-b9c8ffb49be2 successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 for user 6cb95f539cc0441c8fdb56ed02cb2417 is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Marking volume 184b424b-7693-4f11-bb29-b9c8ffb49be2 as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Copying metadata from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 to 184b424b-7693-4f11-bb29-b9c8ffb49be2. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:29:14 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Creating volume glance metadata for volume 184b424b-7693-4f11-bb29-b9c8ffb49be2 backed by image 80bdb979-36ce-4750-96f5-dc31bfd10d53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:29:15 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img" returned: 0 in 4.720s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[333da3db-f61f-4273-ae0d-9b382fcb387a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204bd42e-e949-4eb7-ac76-f86ba3a5b29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184b424b-7693-4f11-bb29-b9c8ffb49be2', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea13f48c-cd4e-46d2-a2fe-20083644f1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Volume volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 (184b424b-7693-4f11-bb29-b9c8ffb49be2): created successfully Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea13f48c-cd4e-46d2-a2fe-20083644f1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Flow 'volume_create_manager' (32321fc0-02bb-4043-95a3-c43847c4ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-425aafcf-f1e0-4b9d-ad79-5f8cc268cf9b tempest-VolumesExtendTest-1721425857 None] Created volume successfully. Jul 28 16:29:15 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:29:15 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:15 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.588s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:29:15 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Converted 1024.00 MB image at 216.90 MB/s Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] 10c839c3-1b28-4458-b24c-e9de9c25e33d was raw, converting to qcow2 {{(pid=88286) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7d8d7b-bff5-44c6-bb95-134fcef81fdd]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:15 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img Jul 28 16:29:15 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:15 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img" returned: 0 in 0.319s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:16 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img Jul 28 16:29:16 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:16 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img" returned: 1 in 0.342s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img /opt/stack/data/cinder/conversion/vol_upload_p02mrrcg {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:16 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img /opt/stack/data/cinder/conversion/vol_upload_p02mrrcg Jul 28 16:29:16 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:16 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img /opt/stack/data/cinder/conversion/vol_upload_p02mrrcg" returned: 0 in 0.262s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Image conversion details: src /opt/stack/data/cinder/conversion/8a099aa3-0f93-4de5-a16f-6767cc9b630a.temp_image.10c839c3-1b28-4458-b24c-e9de9c25e33dr6aps5kw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_p02mrrcg {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:29:16 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc625f-f9f1-4259-be13-623544b3967e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p02mrrcg {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:16 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p02mrrcg Jul 28 16:29:16 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:16 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p02mrrcg" returned: 0 in 0.343s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.932s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Uploaded volume to glance image-id: 10c839c3-1b28-4458-b24c-e9de9c25e33d. {{(pid=88286) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.297s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Creating offline snapshot 8bb7097c-7311-448b-8c7a-09e5a234909f of volume ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:29:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-dc431934-efcc-47f6-a170-add525aab62a tempest-VolumesActionsTest-1368005194 None] Copy volume to image completed successfully. Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c0e354-d412-434b-ba8b-48ac1348a6b6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:18 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 Jul 28 16:29:18 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:18 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" returned: 0 in 0.400s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:18 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f 1G Jul 28 16:29:18 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Acquiring lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Acquiring lock "cinder-quobyte-8a099aa3-0f93-4de5-a16f-6767cc9b630a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Lock "cinder-quobyte-8a099aa3-0f93-4de5-a16f-6767cc9b630a" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d946d9-39cd-45b1-87a3-01461b115e55]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:19 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f 1G" returned: 0 in 0.492s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:19 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f Jul 28 16:29:19 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:19 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:29:19 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:19 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.390s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:19 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:19 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:19 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a Jul 28 16:29:19 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:19 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f Jul 28 16:29:19 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:19 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8a099aa3-0f93-4de5-a16f-6767cc9b630a" returned: 0 in 0.266s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Lock "cinder-quobyte-8a099aa3-0f93-4de5-a16f-6767cc9b630a" released by "delete_volume" :: held 0.701s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:19 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f" returned: 0 in 0.286s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:19 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.info Jul 28 16:29:19 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:19 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Created reservations ['caea24a0-a615-4068-9847-2884ef7771e7', '4c9932c2-02c2-48ce-b4df-0e73def21a00', '77d5ea16-f87f-48be-b3ab-61ed56568cc5', 'd913c720-78a3-4ef4-ae34-20bf384a60a2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:20 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:29:20 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:20 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.info" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:20 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:20 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.info Jul 28 16:29:20 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:20 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.296s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:29:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Deleted volume successfully. Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-baf9bf3c-b9c5-4a17-bebe-12cf2212192c tempest-VolumesActionsTest-1368005194 None] Lock "cinder-8a099aa3-0f93-4de5-a16f-6767cc9b630a-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:20 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.info" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.967s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8442eb5-cfaf-4633-bddb-522151c893ed]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:20 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 Jul 28 16:29:20 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cdc57a56-07c2-4395-8a1d-ab2cca4468bd tempest-GroupSnapshotsTest-369984384 None] group_snapshot 9d564b3d-8407-4d12-b948-42384f8a7e5f: created successfully Jul 28 16:29:21 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2" returned: 0 in 0.477s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 2G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 2G" returned: 0 in 0.130s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.649s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2d3f319b-2577-4b1e-ae4f-e46df83c3fa1 tempest-VolumesExtendTest-1721425857 None] Extend volume completed successfully. Jul 28 16:29:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] group_snapshot 9d564b3d-8407-4d12-b948-42384f8a7e5f: deleting Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] group_snapshot 9d564b3d-8407-4d12-b948-42384f8a7e5f: deleting {{(pid=88286) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-8bb7097c-7311-448b-8c7a-09e5a234909f" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-8bb7097c-7311-448b-8c7a-09e5a234909f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Deleting offline snapshot 8bb7097c-7311-448b-8c7a-09e5a234909f of volume ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] snapshot_file for this snap is: volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[92800095-e6d0-45ca-991f-73a4a0385492]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:22 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f Jul 28 16:29:22 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "cinder-184b424b-7693-4f11-bb29-b9c8ffb49be2-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-184b424b-7693-4f11-bb29-b9c8ffb49be2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "cinder-quobyte-184b424b-7693-4f11-bb29-b9c8ffb49be2" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-184b424b-7693-4f11-bb29-b9c8ffb49be2" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3651beb4-45a5-4164-b97e-4bc6a06d21f9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:22 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f" returned: 0 in 0.484s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:22 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 Jul 28 16:29:22 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa94b56-f959-407d-94f7-b6f9de64328c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:22 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 Jul 28 16:29:22 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:22 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2" returned: 0 in 0.415s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:22 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2 Jul 28 16:29:22 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:23 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" returned: 0 in 0.426s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:23 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f Jul 28 16:29:23 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:23 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-184b424b-7693-4f11-bb29-b9c8ffb49be2" returned: 0 in 0.329s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-184b424b-7693-4f11-bb29-b9c8ffb49be2" released by "delete_volume" :: held 0.799s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Created reservations ['4805fcc2-b9ed-4f01-bc85-2ea500a4ba10', '387cf44f-3e75-4145-ad5e-ee66f54578a9', '23c07251-8748-4ddc-bf9a-c050078ac77f', '06257db0-8e90-4b22-a86b-92090c454b11'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:23 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:29:23 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:23 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f" returned: 0 in 0.615s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:23 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f Jul 28 16:29:23 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:23 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.363s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:29:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Deleted volume successfully. Jul 28 16:29:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8bd07b2-836b-42b1-8ff5-c4b32c42b751 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-184b424b-7693-4f11-bb29-b9c8ffb49be2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:24 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77.8bb7097c-7311-448b-8c7a-09e5a234909f" returned: 0 in 0.367s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-8bb7097c-7311-448b-8c7a-09e5a234909f" released by "_delete_snapshot" :: held 2.064s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" released by "delete_snapshot" :: held 2.095s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:24 devstack cinder-volume[88286]: WARNING cinder.quota [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1093599140 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1093599140, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:29:24 devstack cinder-volume[88286]: WARNING cinder.quota [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1093599140 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1093599140, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['7c4ccbc1-5b97-4a27-87d2-989d63ed8d5e', 'aed63783-0293-43a0-8621-998b364312e4', '6927ea41-1832-421a-bccd-28017379c98e', '45135746-7bd2-4218-bc6e-1bbb33ae0229'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Flow 'volume_create_manager' (7ccedae4-b52b-4d8d-b1c8-5226d6110f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64cda66-b5a1-44f8-8495-b3935b10abed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64cda66-b5a1-44f8-8495-b3935b10abed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-793034154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89947e6-aa65-4d86-91f0-dffd26104b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cef832d97a405e8750ba87c229c5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:29:24Z,use_quota=True,user_id='6cb95f539cc0441c8fdb56ed02cb2417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2660847b-624f-49aa-a0a0-77f144073b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2660847b-624f-49aa-a0a0-77f144073b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eed372-e2a5-44fe-80cf-f0c836c6bc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eed372-e2a5-44fe-80cf-f0c836c6bc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd89947e6-aa65-4d86-91f0-dffd26104b91', 'volume_name': 'volume-d89947e6-aa65-4d86-91f0-dffd26104b91', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6f1724-9613-4185-a747-6a97a47ee272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6f1724-9613-4185-a747-6a97a47ee272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7dba359-fa7a-44bd-83c5-52bcfe8793eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:24 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Volume d89947e6-aa65-4d86-91f0-dffd26104b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d89947e6-aa65-4d86-91f0-dffd26104b91', 'volume_size': 1} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-793034154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89947e6-aa65-4d86-91f0-dffd26104b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cef832d97a405e8750ba87c229c5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:29:24Z,use_quota=True,user_id='6cb95f539cc0441c8fdb56ed02cb2417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Creating volume d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:29:24 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:24 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 1073741824 Jul 28 16:29:24 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-eae81fb4-d59e-4970-a35f-2745381f6ab2 tempest-GroupSnapshotsTest-369984384 None] group_snapshot 9d564b3d-8407-4d12-b948-42384f8a7e5f: deleted successfully Jul 28 16:29:24 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 1073741824" returned: 0 in 0.505s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:24 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 Jul 28 16:29:24 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:25 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91" returned: 0 in 0.261s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7dba359-fa7a-44bd-83c5-52bcfe8793eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89947e6-aa65-4d86-91f0-dffd26104b91', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36ca7e8-454f-4d01-8fd6-766d56150f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:25 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Volume volume-d89947e6-aa65-4d86-91f0-dffd26104b91 (d89947e6-aa65-4d86-91f0-dffd26104b91): created successfully Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36ca7e8-454f-4d01-8fd6-766d56150f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Flow 'volume_create_manager' (7ccedae4-b52b-4d8d-b1c8-5226d6110f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0c299544-1c59-45bc-84a9-a50aa9c55404 tempest-VolumesExtendTest-1721425857 None] Created volume successfully. Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "cinder-quobyte-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c63c1e-7eac-4cf2-9c72-f15b85eeb7c0]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:25 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 Jul 28 16:29:25 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:26 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" returned: 0 in 0.373s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:26 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77 Jul 28 16:29:26 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:26 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Lock "cinder-quobyte-ea3f25e4-8031-4e47-a8fc-7ad752abbe77" released by "delete_volume" :: held 0.737s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['42a0a8f5-c486-4d49-a5c4-4d2f477c690c'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:26 devstack cinder-volume[88286]: WARNING cinder.quota [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1093599140 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1093599140, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Creating offline snapshot e7fe896c-8cbb-4760-b79e-aa6bd646652c of volume d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Created reservations ['989e7463-62f6-457a-b30a-e43cfcc35282', '11e8f1df-2366-4d26-bfcd-dfe2990a4093', '7294033e-b1d9-4d79-94ad-612d8c1ce6ee', 'dbfee815-3313-4443-bda0-a38a338c0846'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e6ddc-0bd2-4aa8-903c-32c54c30d753]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:26 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 Jul 28 16:29:26 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:26 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:29:26 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:26 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:26 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.305s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91" returned: 0 in 0.433s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:27 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-faaa79c3-df29-4895-9333-a53140c2e8f8 tempest-GroupSnapshotsTest-369984384 None] Delete group completed successfully. Jul 28 16:29:27 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c 1G Jul 28 16:29:27 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Flow 'volume_create_manager' (61e2d3a2-ba37-4f86-847f-aa6c4a52fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b887a5-03ca-4108-8f07-e24a89c723e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b887a5-03ca-4108-8f07-e24a89c723e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-98387504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717fdba0-1f51-479f-85bb-90efd96aa06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33d5755c0a44d7487707083d94789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:29:27Z,use_quota=True,user_id='c4563cbaca6d481eb6254427b54e2b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3690875-72c7-42fa-a696-d53760b34e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3690875-72c7-42fa-a696-d53760b34e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56bb1e0-9a80-4e7b-829c-b524efa3ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56bb1e0-9a80-4e7b-829c-b524efa3ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717fdba0-1f51-479f-85bb-90efd96aa06c', 'volume_name': 'volume-717fdba0-1f51-479f-85bb-90efd96aa06c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:27 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c656ea77-7844-4f27-9c77-4653b9da5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c656ea77-7844-4f27-9c77-4653b9da5569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030c2f61-d6cb-4ae4-8097-a0eb1b25a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:27 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Volume 717fdba0-1f51-479f-85bb-90efd96aa06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717fdba0-1f51-479f-85bb-90efd96aa06c', 'volume_size': 1} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c 1G" returned: 0 in 0.599s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d89947e6-aa65-4d86-91f0-dffd26104b91 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:27 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d89947e6-aa65-4d86-91f0-dffd26104b91 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c Jul 28 16:29:27 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:27 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d89947e6-aa65-4d86-91f0-dffd26104b91 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c" returned: 0 in 0.315s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:27 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c is being set with open permissions: ugo+rw Jul 28 16:29:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:27 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c Jul 28 16:29:27 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:28 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c" returned: 0 in 0.257s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:28 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.info Jul 28 16:29:28 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:28 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.info" returned: 0 in 0.276s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:28 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.info is being set with open permissions: ugo+rw Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:28 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.info Jul 28 16:29:28 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:28 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.info" returned: 0 in 0.263s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.174s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-98387504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717fdba0-1f51-479f-85bb-90efd96aa06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33d5755c0a44d7487707083d94789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:29:27Z,use_quota=True,user_id='c4563cbaca6d481eb6254427b54e2b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Creating volume 717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:29:28 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:29:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:28 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c 1073741824 Jul 28 16:29:28 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-be873d6c-40f2-4c78-bf35-5c9fdc0325a5 tempest-VolumesExtendTest-1721425857 None] Create snapshot completed successfully Jul 28 16:29:29 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c 1073741824" returned: 0 in 0.502s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:29 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c Jul 28 16:29:29 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:29 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c" returned: 0 in 0.280s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030c2f61-d6cb-4ae4-8097-a0eb1b25a005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717fdba0-1f51-479f-85bb-90efd96aa06c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82483688-40b7-48c7-8db4-92b37456c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:29 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Volume volume-717fdba0-1f51-479f-85bb-90efd96aa06c (717fdba0-1f51-479f-85bb-90efd96aa06c): created successfully Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82483688-40b7-48c7-8db4-92b37456c61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Flow 'volume_create_manager' (61e2d3a2-ba37-4f86-847f-aa6c4a52fd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:29 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-eb50a66b-dc1b-4ce8-8535-ff5efcfe1769 tempest-VolumesCloneTest-1129168406 None] Created volume successfully. Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4636e776-db0e-4485-ac98-c817813c24db]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:29 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 Jul 28 16:29:29 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:30 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91" returned: 0 in 0.384s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c 2G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c 2G" returned: 0 in 0.139s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.564s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3c71c47f-ed89-416b-a2d3-173ab2a8e412 tempest-VolumesExtendTest-1721425857 None] Extend volume completed successfully. Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Acquiring lock "cinder-e7fe896c-8cbb-4760-b79e-aa6bd646652c-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Lock "cinder-e7fe896c-8cbb-4760-b79e-aa6bd646652c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Acquiring lock "cinder-quobyte-d89947e6-aa65-4d86-91f0-dffd26104b91" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-d89947e6-aa65-4d86-91f0-dffd26104b91" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Acquiring lock "cinder-quobyte-e7fe896c-8cbb-4760-b79e-aa6bd646652c" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-e7fe896c-8cbb-4760-b79e-aa6bd646652c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Deleting offline snapshot e7fe896c-8cbb-4760-b79e-aa6bd646652c of volume d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] snapshot_file for this snap is: volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Flow 'volume_create_manager' (183c5ec6-cdd7-46cf-b910-d0e266acc54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a647f5a1-e6dd-4a26-85ac-7a26f22dfee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c13b184-f373-4f21-8045-2abc87c5a805]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a647f5a1-e6dd-4a26-85ac-7a26f22dfee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1904770147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c0b4c4-b260-41ab-b0e9-94dc9bd56450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33d5755c0a44d7487707083d94789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:29:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=717fdba0-1f51-479f-85bb-90efd96aa06c,status='creating',terminated_at=None,updated_at=2026-07-28T14:29:31Z,use_quota=True,user_id='c4563cbaca6d481eb6254427b54e2b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0852da-d389-43c8-b7bb-4ca804186d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0852da-d389-43c8-b7bb-4ca804186d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1898352d-b121-4518-9b7b-5c5fea212dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1898352d-b121-4518-9b7b-5c5fea212dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e9c0b4c4-b260-41ab-b0e9-94dc9bd56450', 'volume_name': 'volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450', 'volume_size': 2, 'source_volid': '717fdba0-1f51-479f-85bb-90efd96aa06c', 'source_volstatus': 'available'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec4cb7a-d3a1-4619-aada-e47ce7594c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec4cb7a-d3a1-4619-aada-e47ce7594c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6c5e51-56af-49db-85fc-f0e2d5bb8e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:31 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Volume e9c0b4c4-b260-41ab-b0e9-94dc9bd56450: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450', 'volume_size': 2, 'source_volid': '717fdba0-1f51-479f-85bb-90efd96aa06c', 'source_volstatus': 'available'} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:31 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Cloning volume 717fdba0-1f51-479f-85bb-90efd96aa06c to volume e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 Jul 28 16:29:31 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c Jul 28 16:29:31 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Creating offline snapshot ded50a1f-5a15-4979-8b38-2ae7b1efaf3c of volume 717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f078636f-7e38-40fc-bad7-196ad6174807]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:31 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c Jul 28 16:29:31 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:31 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c" returned: 0 in 0.418s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d89947e6-aa65-4d86-91f0-dffd26104b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f41b73-c024-4166-97c4-d0c290e0902d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:31 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c" returned: 0 in 0.391s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:31 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c 1G Jul 28 16:29:31 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:31 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 Jul 28 16:29:31 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:32 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91" returned: 0 in 0.429s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:32 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c Jul 28 16:29:32 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:32 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c 1G" returned: 0 in 0.499s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717fdba0-1f51-479f-85bb-90efd96aa06c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:32 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717fdba0-1f51-479f-85bb-90efd96aa06c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c Jul 28 16:29:32 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:32 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c" returned: 0 in 0.460s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:32 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717fdba0-1f51-479f-85bb-90efd96aa06c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:32 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c is being set with open permissions: ugo+rw Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:32 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c Jul 28 16:29:32 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:32 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c Jul 28 16:29:32 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:32 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91.e7fe896c-8cbb-4760-b79e-aa6bd646652c" returned: 0 in 0.254s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:32 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" returned: 0 in 0.277s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-e7fe896c-8cbb-4760-b79e-aa6bd646652c" released by "_delete_snapshot" :: held 1.709s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-d89947e6-aa65-4d86-91f0-dffd26104b91" released by "delete_snapshot" :: held 1.750s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:32 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.info Jul 28 16:29:32 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:32 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Created reservations ['42c55816-24ba-4acd-a06f-d283bf894247', '5368c915-be45-4f4d-8276-cd1f7cee8ce4', '14f98a91-d641-428c-b106-52def1533751', 'c7534ce7-563c-4044-9f40-021bdce0bbda'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Delete snapshot completed successfully. Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-264ec557-b76b-479e-9faa-518777d82f6c tempest-VolumesExtendTest-1721425857 None] Lock "cinder-e7fe896c-8cbb-4760-b79e-aa6bd646652c-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:33 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.info" returned: 0 in 0.286s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:33 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.info is being set with open permissions: ugo+rw Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:33 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.info Jul 28 16:29:33 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "cinder-d89947e6-aa65-4d86-91f0-dffd26104b91-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-d89947e6-aa65-4d86-91f0-dffd26104b91-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "cinder-quobyte-d89947e6-aa65-4d86-91f0-dffd26104b91" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-d89947e6-aa65-4d86-91f0-dffd26104b91" acquired by "delete_volume" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:33 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.info" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "cinder-quobyte-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[76457753-81f0-4a8a-9d7c-32baf00289ab]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] snapshot: ded50a1f-5a15-4979-8b38-2ae7b1efaf3c, volume: e9c0b4c4-b260-41ab-b0e9-94dc9bd56450, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef06d68-901b-4840-8356-0af52bb0f2ca]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:33 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 Jul 28 16:29:33 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:33 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c Jul 28 16:29:33 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:33 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91" returned: 0 in 0.412s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:33 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91 Jul 28 16:29:33 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:34 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" returned: 0 in 0.461s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717fdba0-1f51-479f-85bb-90efd96aa06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a54d6-e2d6-4add-94b3-1a73feed7873]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:34 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c Jul 28 16:29:34 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:34 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d89947e6-aa65-4d86-91f0-dffd26104b91" returned: 0 in 0.371s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-quobyte-d89947e6-aa65-4d86-91f0-dffd26104b91" released by "delete_volume" :: held 0.879s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Created reservations ['d0731c07-4040-47e1-b7a9-5357d4fe7c85', '374ced44-d95e-4fcf-8f26-7a3515d806b8', 'd68fcaa6-a6c2-43de-8237-08dde2975971', '8b4bac00-48ee-4b80-ba51-6fe3dc9e74ef'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:34 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:29:34 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:34 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c" returned: 0 in 0.517s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:29:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:34 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 Jul 28 16:29:34 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:35 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.479s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:35 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:29:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Deleted volume successfully. Jul 28 16:29:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-05fa08dd-23f1-453b-a2c4-ca5e0585d567 tempest-VolumesExtendTest-1721425857 None] Lock "cinder-d89947e6-aa65-4d86-91f0-dffd26104b91-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:40 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" returned: 0 in 5.835s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5557ae-1d2c-4a7a-a92d-f13fb10cc22f]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:40 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c Jul 28 16:29:40 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:41 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c" returned: 0 in 0.587s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:29:41 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Converted 1024.00 MB image at 175.46 MB/s Jul 28 16:29:41 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 is being set with open permissions: ugo+rw Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:41 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 Jul 28 16:29:41 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:41 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:29:41 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:41 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" returned: 0 in 0.360s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" released by "_copy_volume_from_snapshot" :: held 7.885s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "cinder-quobyte-ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:41 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.382s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Deleting offline snapshot ded50a1f-5a15-4979-8b38-2ae7b1efaf3c of volume 717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] snapshot_file for this snap is: volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[115aeced-f101-48d2-b232-990fbd9062e1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Flow 'volume_create_manager' (559fa472-6e43-4065-a741-9e193922ee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c0dd85-01b4-4752-9ab3-87c3183cef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:41 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c Jul 28 16:29:41 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c0dd85-01b4-4752-9ab3-87c3183cef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-737627162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011155b6-19b8-4adf-98d9-000b0e33c060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c1d12e5d6d43afad0e264ab695e0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:29:42Z,use_quota=True,user_id='ce70059900b94fbca377983ad5d5728a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1edc2cf-2631-4cf4-aa0c-b8982b557c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1edc2cf-2631-4cf4-aa0c-b8982b557c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d308464f-74b1-4dab-bdae-2e9a850192bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d308464f-74b1-4dab-bdae-2e9a850192bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011155b6-19b8-4adf-98d9-000b0e33c060', 'volume_name': 'volume-011155b6-19b8-4adf-98d9-000b0e33c060', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dfc1c0-5910-4c5a-9566-9ecc5642b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dfc1c0-5910-4c5a-9566-9ecc5642b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6930e3-f10e-43e3-8e4c-f3f0b539ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:41 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Volume 011155b6-19b8-4adf-98d9-000b0e33c060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011155b6-19b8-4adf-98d9-000b0e33c060', 'volume_size': 1} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:41 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717fdba0-1f51-479f-85bb-90efd96aa06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:42 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[457606df-0d52-420e-b756-a0caa29983e8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:42 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c Jul 28 16:29:42 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:42 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c" returned: 0 in 0.429s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:42 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c Jul 28 16:29:42 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:42 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" returned: 0 in 0.409s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:42 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c Jul 28 16:29:42 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:43 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c.ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" returned: 0 in 0.274s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-ded50a1f-5a15-4979-8b38-2ae7b1efaf3c" released by "_delete_snapshot" :: held 1.694s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.875s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-737627162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011155b6-19b8-4adf-98d9-000b0e33c060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c1d12e5d6d43afad0e264ab695e0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:29:42Z,use_quota=True,user_id='ce70059900b94fbca377983ad5d5728a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Creating volume 011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:29:43 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:43 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 1073741824 Jul 28 16:29:43 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6c5e51-56af-49db-85fc-f0e2d5bb8e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450', 'volume_size': 2, 'source_volid': '717fdba0-1f51-479f-85bb-90efd96aa06c', 'source_volstatus': 'available'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa95dd93-faa0-45c3-85f9-f822a8bb260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:43 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Volume volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 (e9c0b4c4-b260-41ab-b0e9-94dc9bd56450): created successfully Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa95dd93-faa0-45c3-85f9-f822a8bb260b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Flow 'volume_create_manager' (183c5ec6-cdd7-46cf-b910-d0e266acc54a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-168cf8ff-8af3-4ad2-97ce-33381f77a4a7 tempest-VolumesCloneTest-1129168406 None] Created volume successfully. Jul 28 16:29:43 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 1073741824" returned: 0 in 0.542s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:43 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 Jul 28 16:29:43 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:44 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060" returned: 0 in 0.267s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6930e3-f10e-43e3-8e4c-f3f0b539ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011155b6-19b8-4adf-98d9-000b0e33c060', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7d49c9-ab49-4bae-b2df-d172c8aff6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:29:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Volume volume-011155b6-19b8-4adf-98d9-000b0e33c060 (011155b6-19b8-4adf-98d9-000b0e33c060): created successfully Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7d49c9-ab49-4bae-b2df-d172c8aff6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Flow 'volume_create_manager' (559fa472-6e43-4065-a741-9e193922ee41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:29:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-33ecaa71-359a-4633-868b-a087d2e058b4 tempest-VolumesSnapshotListTestJSON-1877024441 None] Created volume successfully. Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "cinder-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "cinder-quobyte-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b94494e-fc85-4c88-b26f-1adb9a5a273d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:44 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 Jul 28 16:29:44 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Creating offline snapshot 89d00436-1615-4d1b-bfe6-05c9745d5495 of volume 011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7865001-f643-4e24-a8bc-3e81ab83e821]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:45 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" returned: 0 in 0.415s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:45 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450 Jul 28 16:29:45 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:45 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 Jul 28 16:29:45 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:45 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450" released by "delete_volume" :: held 0.786s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Created reservations ['0afa32c2-8f7f-40f8-9a66-ca3e761c9af0', 'b3149328-e85f-4807-8a7d-af3d276336e2', '44d25ba2-efb4-4885-8359-f0ab37bc4967', '2ae34193-e1a3-4256-92e4-10ec5a2cee90'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:45 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060" returned: 0 in 0.448s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:45 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 1G Jul 28 16:29:45 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:45 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:29:45 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Acquiring lock "cinder-717fdba0-1f51-479f-85bb-90efd96aa06c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:45 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.295s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:29:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Deleted volume successfully. Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Lock "cinder-717fdba0-1f51-479f-85bb-90efd96aa06c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c420c324-3eb6-49c1-9206-92373b656d89 tempest-VolumesCloneTest-1129168406 None] Lock "cinder-e9c0b4c4-b260-41ab-b0e9-94dc9bd56450-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Acquiring lock "cinder-quobyte-717fdba0-1f51-479f-85bb-90efd96aa06c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-717fdba0-1f51-479f-85bb-90efd96aa06c" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d905a09c-571b-40c0-b80d-2b709dca833e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:46 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 1G" returned: 0 in 0.571s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:46 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 Jul 28 16:29:46 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:46 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c Jul 28 16:29:46 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:46 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495" returned: 0 in 0.371s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:46 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 is being set with open permissions: ugo+rw Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:46 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 Jul 28 16:29:46 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:46 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c" returned: 0 in 0.445s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:46 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c Jul 28 16:29:46 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:46 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:46 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-717fdba0-1f51-479f-85bb-90efd96aa06c" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:46 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.info Jul 28 16:29:46 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Lock "cinder-quobyte-717fdba0-1f51-479f-85bb-90efd96aa06c" released by "delete_volume" :: held 0.809s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Created reservations ['65a99808-a1a1-4dbb-bc66-f1f11b09a1ec', '360f9cf2-b26f-4db9-88b3-da17985ea5bd', 'e6a26318-a726-4347-89d9-768c8c32ff6d', 'a2f40f24-b321-41b8-bffb-10fa967f6811'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:47 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:29:47 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:47 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.info" returned: 0 in 0.410s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:47 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.info is being set with open permissions: ugo+rw Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:47 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.info Jul 28 16:29:47 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:47 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.375s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:29:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Deleted volume successfully. Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-550bc38f-b7a4-45e2-95ee-3ceae662da1e tempest-VolumesCloneTest-1129168406 None] Lock "cinder-717fdba0-1f51-479f-85bb-90efd96aa06c-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:47 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.info" returned: 0 in 0.357s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-71f9c276-e6e4-479c-a69a-7b44ec17b59f tempest-VolumesSnapshotListTestJSON-1877024441 None] Create snapshot completed successfully Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Creating offline snapshot 67bcd4a3-3c78-40b2-9a8e-69a503027012 of volume 011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c2c402-e611-4552-af43-bc8c878c2bb6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:48 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 Jul 28 16:29:48 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:48 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495" returned: 0 in 0.465s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011155b6-19b8-4adf-98d9-000b0e33c060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:49 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 1G Jul 28 16:29:49 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:49 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 1G" returned: 0 in 0.552s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:49 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 Jul 28 16:29:49 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:49 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012" returned: 0 in 0.374s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:49 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 is being set with open permissions: ugo+rw Jul 28 16:29:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:49 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 Jul 28 16:29:49 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:50 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012" returned: 0 in 0.280s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a02c9061-ae18-432e-82b6-d93050e344dc tempest-VolumesSnapshotListTestJSON-1877024441 None] Create snapshot completed successfully Jul 28 16:29:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:29:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:29:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Creating offline snapshot 95ba8043-1342-4632-a68f-38a2a1a1eb75 of volume 011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:29:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf06fa-61dc-4347-b249-bc2aecd1ffd7]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:51 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 Jul 28 16:29:51 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:51 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012" returned: 0 in 0.459s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011155b6-19b8-4adf-98d9-000b0e33c060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:51 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 1G Jul 28 16:29:51 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:52 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 1G" returned: 0 in 0.742s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:52 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 Jul 28 16:29:52 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:52 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75" returned: 0 in 0.376s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:52 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 is being set with open permissions: ugo+rw Jul 28 16:29:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:52 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 Jul 28 16:29:52 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:52 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75" returned: 0 in 0.278s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.992s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:29:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3f508471-8696-499e-ab4f-c6051a1f97aa tempest-VolumesSnapshotListTestJSON-1877024441 None] Create snapshot completed successfully Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-95ba8043-1342-4632-a68f-38a2a1a1eb75-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-95ba8043-1342-4632-a68f-38a2a1a1eb75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-quobyte-95ba8043-1342-4632-a68f-38a2a1a1eb75" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-95ba8043-1342-4632-a68f-38a2a1a1eb75" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Deleting offline snapshot 95ba8043-1342-4632-a68f-38a2a1a1eb75 of volume 011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] snapshot_file for this snap is: volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc1e21-e227-4ac5-80bb-9a132a928775]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:55 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 Jul 28 16:29:55 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:55 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75" returned: 0 in 0.452s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011155b6-19b8-4adf-98d9-000b0e33c060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[549d352d-68a1-4bcd-8938-94359bbf76a6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:55 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 Jul 28 16:29:55 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:56 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012" returned: 0 in 0.535s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011155b6-19b8-4adf-98d9-000b0e33c060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:56 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 Jul 28 16:29:56 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:56 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75" returned: 0 in 0.636s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:56 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75 Jul 28 16:29:56 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:57 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.95ba8043-1342-4632-a68f-38a2a1a1eb75" returned: 0 in 0.350s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-95ba8043-1342-4632-a68f-38a2a1a1eb75" released by "_delete_snapshot" :: held 2.141s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" released by "delete_snapshot" :: held 2.170s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:57 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Created reservations ['0094928e-1992-4a05-9e9f-d27a964a847e', '0365f7a1-b89a-4d29-82d5-f9f7828bf3e0', 'ca441776-8978-400e-b3df-2c56ecd69363', '99235cac-7147-4a67-a152-b16b347ee9f7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:29:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Delete snapshot completed successfully. Jul 28 16:29:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-75ea76cb-6819-4f8b-a453-b420a94e5b48 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-95ba8043-1342-4632-a68f-38a2a1a1eb75-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-67bcd4a3-3c78-40b2-9a8e-69a503027012-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-67bcd4a3-3c78-40b2-9a8e-69a503027012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-quobyte-67bcd4a3-3c78-40b2-9a8e-69a503027012" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-67bcd4a3-3c78-40b2-9a8e-69a503027012" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Deleting offline snapshot 67bcd4a3-3c78-40b2-9a8e-69a503027012 of volume 011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] snapshot_file for this snap is: volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa67a03-edaa-4bd2-964b-a40c9ff5d9cd]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:58 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 Jul 28 16:29:58 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:58 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012" returned: 0 in 0.517s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011155b6-19b8-4adf-98d9-000b0e33c060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba172572-db89-4e37-b237-9a9684f4f336]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:29:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:59 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 Jul 28 16:29:59 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:29:59 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 28 16:29:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495" returned: 0 in 0.460s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:29:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011155b6-19b8-4adf-98d9-000b0e33c060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:29:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:29:59 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 Jul 28 16:29:59 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:00 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012" returned: 0 in 0.558s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:00 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012 Jul 28 16:30:00 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:00 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.67bcd4a3-3c78-40b2-9a8e-69a503027012" returned: 0 in 0.351s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-67bcd4a3-3c78-40b2-9a8e-69a503027012" released by "_delete_snapshot" :: held 2.028s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" released by "delete_snapshot" :: held 2.054s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:00 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Created reservations ['fa556598-8f89-405a-8438-8634258c8991', 'efe0cb7b-ef9b-4fd2-9a85-48a2273e2863', '7d6091e0-a12a-4d0b-a5c7-2e4879dbe19d', 'c1172d54-90ba-4d85-9ac8-4141c0f5423d'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Delete snapshot completed successfully. Jul 28 16:30:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b06cd55-8301-4dd7-84ab-93c01d80b071 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-67bcd4a3-3c78-40b2-9a8e-69a503027012-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-89d00436-1615-4d1b-bfe6-05c9745d5495-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-89d00436-1615-4d1b-bfe6-05c9745d5495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-quobyte-89d00436-1615-4d1b-bfe6-05c9745d5495" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-89d00436-1615-4d1b-bfe6-05c9745d5495" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Deleting offline snapshot 89d00436-1615-4d1b-bfe6-05c9745d5495 of volume 011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] snapshot_file for this snap is: volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee91ff8c-1528-4dbf-8d2f-325a15a9dbb1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:01 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 Jul 28 16:30:01 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:02 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495" returned: 0 in 0.415s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011155b6-19b8-4adf-98d9-000b0e33c060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:30:02 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f9b72-221c-4a47-9972-b54de9ebe360]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:02 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 Jul 28 16:30:02 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:02 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060" returned: 0 in 0.467s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:02 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 Jul 28 16:30:02 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:03 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495" returned: 0 in 0.465s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:03 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495 Jul 28 16:30:03 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:03 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060.89d00436-1615-4d1b-bfe6-05c9745d5495" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-89d00436-1615-4d1b-bfe6-05c9745d5495" released by "_delete_snapshot" :: held 1.863s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" released by "delete_snapshot" :: held 1.895s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Created reservations ['1b1b4259-b065-4de7-a726-55c0ef76cb71', '45d03d2c-7e23-4739-816b-3b038957ae63', '8fa2fd13-0f06-442f-ae4c-47be6a260d81', '448d096a-4bec-482c-9766-ffa2ce825484'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Delete snapshot completed successfully. Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f1b6f84-14e2-4f46-bd65-818b61358672 tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-89d00436-1615-4d1b-bfe6-05c9745d5495-delete_snapshot" released by "delete_snapshot" :: held 2.093s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-011155b6-19b8-4adf-98d9-000b0e33c060-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-011155b6-19b8-4adf-98d9-000b0e33c060-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c27169-7597-42a7-a9f0-eb5206e87196]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:04 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 Jul 28 16:30:04 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:04 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060" returned: 0 in 0.501s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:04 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060 Jul 28 16:30:04 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:04 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-011155b6-19b8-4adf-98d9-000b0e33c060" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-quobyte-011155b6-19b8-4adf-98d9-000b0e33c060" released by "delete_volume" :: held 0.899s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=115,cinder:INSERT=38,cinder:DELETE=7,cinder:SELECT=104 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=106,cinder:UPDATE=110,cinder:INSERT=30,cinder:DELETE=8 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:30:04 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Created reservations ['15e992dd-f527-4b6b-a2e1-a42feb9100eb', 'b3200788-4a74-4e62-9462-47c29233b4dd', '0b635a26-6a0d-433b-af32-96d5910acdc9', 'cd3f106d-e711-4aa4-bb12-b8327639cb27'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:05 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:30:05 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:05 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.370s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:30:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Deleted volume successfully. Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ec2c38-92ec-4715-84ce-414bc28c127c tempest-VolumesSnapshotListTestJSON-1877024441 None] Lock "cinder-011155b6-19b8-4adf-98d9-000b0e33c060-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Flow 'volume_create_manager' (2b84f7f2-d0eb-4704-8e64-339c9990c313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d2a93d-0ad0-48c1-bb1f-b46ca9192833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d2a93d-0ad0-48c1-bb1f-b46ca9192833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-337192095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4799109c-5dfd-4f33-832c-620b9f30c21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3bbf54194046238b3910f79521b016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:06Z,use_quota=True,user_id='2e4a60b17db8457a9fe0f5b39bd23ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4008582b-8fc7-4f81-ad55-054041e36f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4008582b-8fc7-4f81-ad55-054041e36f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bfe021-bc36-44c7-a3b9-c1d51206f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:05 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bfe021-bc36-44c7-a3b9-c1d51206f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4799109c-5dfd-4f33-832c-620b9f30c21f', 'volume_name': 'volume-4799109c-5dfd-4f33-832c-620b9f30c21f', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d43628-abcb-4f8b-9846-3987c9628f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d43628-abcb-4f8b-9846-3987c9628f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5167c1ca-481d-4e04-ba3f-971fb84cc04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:06 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Volume 4799109c-5dfd-4f33-832c-620b9f30c21f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4799109c-5dfd-4f33-832c-620b9f30c21f', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Trying to clone 4799109c-5dfd-4f33-832c-620b9f30c21f from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:30:06 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Image download 20.69 MB at 20.69 MB/s Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e4d72d-3053-45ec-9e9b-6ab877321bd9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:06 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD Jul 28 16:30:06 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:07 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 is fetched for user 2e4a60b17db8457a9fe0f5b39bd23ae8. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a95c9c-e8ba-4576-86ae-a209c59560b4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:07 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD Jul 28 16:30:07 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:07 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-337192095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4799109c-5dfd-4f33-832c-620b9f30c21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3bbf54194046238b3910f79521b016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:06Z,use_quota=True,user_id='2e4a60b17db8457a9fe0f5b39bd23ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Creating volume 4799109c-5dfd-4f33-832c-620b9f30c21f {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:30:07 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:30:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:07 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f 1073741824 Jul 28 16:30:07 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:08 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f 1073741824" returned: 0 in 0.569s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:08 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f Jul 28 16:30:08 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:08 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f" returned: 0 in 0.421s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Attempting download of 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume 4799109c-5dfd-4f33-832c-620b9f30c21f. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c1feea-596b-472b-bdd9-f392c5a62273]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_390t6ncr {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:09 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_390t6ncr Jul 28 16:30:09 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:09 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Flow 'volume_create_manager' (45e43bed-9696-4935-9b44-451a7a5d4f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac61cbfa-d517-42b4-be38-48c67512bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_390t6ncr" returned: 0 in 0.529s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_390t6ncr {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac61cbfa-d517-42b4-be38-48c67512bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-917871604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb61ea2a-13ae-43bb-86e9-a9ad066f2875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1a34aab2654053bccf837bbb8cf978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:09Z,use_quota=True,user_id='6477936df7e04612afe1b7b06789627f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a50f92b-cd47-4048-8b9d-b8f4b95b12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a50f92b-cd47-4048-8b9d-b8f4b95b12c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11650b1c-2f52-4e7e-9961-61bd385c10f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11650b1c-2f52-4e7e-9961-61bd385c10f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb61ea2a-13ae-43bb-86e9-a9ad066f2875', 'volume_name': 'volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875', 'volume_size': 2}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2f6ca-967f-4b33-a9f9-06e63628db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2f6ca-967f-4b33-a9f9-06e63628db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aceded-10e3-4fb9-b3fb-2f2e102118e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:09 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Volume cb61ea2a-13ae-43bb-86e9-a9ad066f2875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875', 'volume_size': 2} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-917871604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb61ea2a-13ae-43bb-86e9-a9ad066f2875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1a34aab2654053bccf837bbb8cf978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:09Z,use_quota=True,user_id='6477936df7e04612afe1b7b06789627f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Creating volume cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:30:09 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 2147483648 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:09 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 2147483648 Jul 28 16:30:09 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:09 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_390t6ncr Jul 28 16:30:09 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:09 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_390t6ncr" returned: 1 in 0.373s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_390t6ncr' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8a76c9-b494-4637-8b4e-c6cc4ff560f7]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:09 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD Jul 28 16:30:09 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:10 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:10 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] 80bdb979-36ce-4750-96f5-dc31bfd10d53 was qcow2, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 2147483648" returned: 0 in 0.748s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:10 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f Jul 28 16:30:10 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:10 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 Jul 28 16:30:10 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:10 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" returned: 0 in 0.362s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aceded-10e3-4fb9-b3fb-2f2e102118e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875', 'volume_size': 2}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f8b2ee-a434-48be-ace8-f57205750810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Volume volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 (cb61ea2a-13ae-43bb-86e9-a9ad066f2875): created successfully Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f8b2ee-a434-48be-ace8-f57205750810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Flow 'volume_create_manager' (45e43bed-9696-4935-9b44-451a7a5d4f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f9eeaf2c-c945-4c48-b06b-f11cf3ce8634 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Created volume successfully. Jul 28 16:30:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Creating offline snapshot 9664f078-00c1-4ced-b0df-c06cb6ac479f of volume cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:30:11 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e359b77-e6e4-4630-ae9f-1b8222b67061]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:11 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 Jul 28 16:30:11 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:12 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" returned: 0 in 0.486s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f 2G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:12 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f 2G Jul 28 16:30:12 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:12 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f" returned: 0 in 2.285s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_anugvpuzdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:30:12 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Converted 112.00 MB image at 48.97 MB/s Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:12 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f 1G Jul 28 16:30:12 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:12 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f 2G" returned: 0 in 0.541s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:12 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f Jul 28 16:30:12 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:12 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f 1G" returned: 0 in 0.377s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Downloaded image 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume 4799109c-5dfd-4f33-832c-620b9f30c21f successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 for user 2e4a60b17db8457a9fe0f5b39bd23ae8 is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Marking volume 4799109c-5dfd-4f33-832c-620b9f30c21f as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Copying metadata from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 to 4799109c-5dfd-4f33-832c-620b9f30c21f. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:30:12 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Creating volume glance metadata for volume 4799109c-5dfd-4f33-832c-620b9f30c21f backed by image 80bdb979-36ce-4750-96f5-dc31bfd10d53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5167c1ca-481d-4e04-ba3f-971fb84cc04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4799109c-5dfd-4f33-832c-620b9f30c21f', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5014adfd-4d3d-4247-acf6-e29147d24a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:13 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Volume volume-4799109c-5dfd-4f33-832c-620b9f30c21f (4799109c-5dfd-4f33-832c-620b9f30c21f): created successfully Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5014adfd-4d3d-4247-acf6-e29147d24a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Flow 'volume_create_manager' (2b84f7f2-d0eb-4704-8e64-339c9990c313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:13 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-293c1f7c-64cd-4147-9e56-64c9936ba236 tempest-VolumesImageMetadata-206917098 None] Created volume successfully. Jul 28 16:30:13 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f" returned: 0 in 0.399s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:13 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f is being set with open permissions: ugo+rw Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:13 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f Jul 28 16:30:13 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:13 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f" returned: 0 in 0.284s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:13 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.info Jul 28 16:30:13 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Acquiring lock "cinder-4799109c-5dfd-4f33-832c-620b9f30c21f-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Lock "cinder-4799109c-5dfd-4f33-832c-620b9f30c21f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Acquiring lock "cinder-quobyte-4799109c-5dfd-4f33-832c-620b9f30c21f" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Lock "cinder-quobyte-4799109c-5dfd-4f33-832c-620b9f30c21f" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9758e1d7-7e9c-432d-bd80-b8f32dd07c44]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:13 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.info" returned: 0 in 0.373s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:13 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.info is being set with open permissions: ugo+rw Jul 28 16:30:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:13 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f Jul 28 16:30:13 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:13 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.info Jul 28 16:30:13 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:14 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f" returned: 0 in 0.479s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:14 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.info" returned: 0 in 0.349s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:14 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f Jul 28 16:30:14 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cd613e6f-2c67-4454-aa23-0fdbc7afbab0 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Create snapshot completed successfully Jul 28 16:30:14 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4799109c-5dfd-4f33-832c-620b9f30c21f" returned: 0 in 0.317s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Lock "cinder-quobyte-4799109c-5dfd-4f33-832c-620b9f30c21f" released by "delete_volume" :: held 0.854s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Created reservations ['60461c96-c92e-4a11-8b5b-ac0be0dc69b1', '159a659e-e453-4d1c-b718-730f8d1922af', 'f571d48c-950b-4e5f-b001-dea0eec5f99d', '4c24e7eb-6343-4fc4-8377-a1006d56fb18'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:14 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:30:14 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "cinder-9664f078-00c1-4ced-b0df-c06cb6ac479f-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-9664f078-00c1-4ced-b0df-c06cb6ac479f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "cinder-quobyte-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:15 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.358s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-quobyte-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "cinder-quobyte-9664f078-00c1-4ced-b0df-c06cb6ac479f" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Deleted volume successfully. Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-quobyte-9664f078-00c1-4ced-b0df-c06cb6ac479f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Deleting offline snapshot 9664f078-00c1-4ced-b0df-c06cb6ac479f of volume cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] snapshot_file for this snap is: volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b197021-c7b0-424e-938b-49edd894c831 tempest-VolumesImageMetadata-206917098 None] Lock "cinder-4799109c-5dfd-4f33-832c-620b9f30c21f-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f7a4c-129c-4162-8abb-9789810b0bf6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:15 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f Jul 28 16:30:15 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Flow 'volume_create_manager' (e1abebf7-ae26-4963-b2f4-ea0de475a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247338e9-2558-4ba0-8af0-a6931e6cc30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247338e9-2558-4ba0-8af0-a6931e6cc30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-106232149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bbbc51-e21e-4277-952e-6b0bec59969b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f356572288f476c85740b7428e5021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:15Z,use_quota=True,user_id='b1696c3b97bc4f0cbf2ba44fba3b58b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a80356a-8651-49ee-9ab2-cb16a3dee051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a80356a-8651-49ee-9ab2-cb16a3dee051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8e2f1-00d7-4627-8796-0964796a1681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8e2f1-00d7-4627-8796-0964796a1681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bbbc51-e21e-4277-952e-6b0bec59969b', 'volume_name': 'volume-25bbbc51-e21e-4277-952e-6b0bec59969b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abe35a9-26b6-4017-8102-9c6b0ebd9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abe35a9-26b6-4017-8102-9c6b0ebd9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d824173-d507-4ab8-b457-5c1d091f5185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Volume 25bbbc51-e21e-4277-952e-6b0bec59969b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bbbc51-e21e-4277-952e-6b0bec59969b', 'volume_size': 1} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-106232149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bbbc51-e21e-4277-952e-6b0bec59969b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f356572288f476c85740b7428e5021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:15Z,use_quota=True,user_id='b1696c3b97bc4f0cbf2ba44fba3b58b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Creating volume 25bbbc51-e21e-4277-952e-6b0bec59969b {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:30:15 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:15 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b 1073741824 Jul 28 16:30:15 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:15 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f" returned: 0 in 0.515s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af19868-eb98-4355-a563-26e4305fec0d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:15 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 Jul 28 16:30:15 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:16 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b 1073741824" returned: 0 in 0.579s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:16 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" returned: 0 in 0.464s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:16 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:16 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:16 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b Jul 28 16:30:16 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:16 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b" returned: 0 in 0.342s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d824173-d507-4ab8-b457-5c1d091f5185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bbbc51-e21e-4277-952e-6b0bec59969b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9965dd2e-4890-4a63-802e-31cf8371e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:16 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Volume volume-25bbbc51-e21e-4277-952e-6b0bec59969b (25bbbc51-e21e-4277-952e-6b0bec59969b): created successfully Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9965dd2e-4890-4a63-802e-31cf8371e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Flow 'volume_create_manager' (e1abebf7-ae26-4963-b2f4-ea0de475a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:16 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:16 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a29ccbc5-93d2-4193-97ae-8b5e05fcccb3 tempest-TestImageHashVerification-1162349938 None] Created volume successfully. Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:16 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f Jul 28 16:30:16 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:16 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875.9664f078-00c1-4ced-b0df-c06cb6ac479f" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-quobyte-9664f078-00c1-4ced-b0df-c06cb6ac479f" released by "_delete_snapshot" :: held 1.886s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-quobyte-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" released by "delete_snapshot" :: held 1.917s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Created reservations ['902d6adf-7dbb-4958-b6b3-bb8376e9d28c', '6286a89a-8af8-4eb4-8258-53496834541c', '262b5491-e54c-4ecd-ba49-1e592a25410c', '6a4cbbdf-8fdf-4f21-8de1-a816c86a328f'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Delete snapshot completed successfully. Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-621c5fac-b3dc-42f8-aad6-0cc46b0bafa8 tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-9664f078-00c1-4ced-b0df-c06cb6ac479f-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "cinder-cb61ea2a-13ae-43bb-86e9-a9ad066f2875-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-cb61ea2a-13ae-43bb-86e9-a9ad066f2875-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "cinder-quobyte-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-quobyte-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0936cfe-c072-47da-a9e2-8c4316cfed18]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:17 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 Jul 28 16:30:17 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:17 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" returned: 0 in 0.445s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:17 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875 Jul 28 16:30:17 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:18 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" returned: 0 in 0.290s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-quobyte-cb61ea2a-13ae-43bb-86e9-a9ad066f2875" released by "delete_volume" :: held 0.830s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Created reservations ['69bed046-b026-410b-bb46-543225cb1ec2', '05b590fd-6c3a-4bb2-87c5-641ef9223bd5', '3cef78bf-22b3-4ece-99a7-796d3b6142cb', '8ded48cc-e739-4bf3-8aec-9c93898efac8'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:18 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:30:18 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:18 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.349s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d13ca98-9c68-43d4-a957-a749018f5f86]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Deleted volume successfully. Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Flow 'volume_create_manager' (5e9cbd6a-a381-43cc-b418-0cd0b141c1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edcaf4f-8535-43ba-b35e-90ba520b813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edcaf4f-8535-43ba-b35e-90ba520b813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-353433352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8f6353-8150-459e-bf3b-fe11b91c9ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a57982e84433693a98d8cf4a1db7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:19Z,use_quota=True,user_id='1de503aa821341e68a414bd2c8631ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3336afda-2028-44b7-b2d4-70815801d165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3336afda-2028-44b7-b2d4-70815801d165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc391a0-d282-45d3-b5ba-76eae10bf138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc391a0-d282-45d3-b5ba-76eae10bf138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8f6353-8150-459e-bf3b-fe11b91c9ff8', 'volume_name': 'volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8', 'volume_size': 2}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f2d25f-7ad8-4e6f-82df-1097f310c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f2d25f-7ad8-4e6f-82df-1097f310c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:18 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b Jul 28 16:30:18 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a42c2e-1ef4-4112-899e-067b9daee90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:18 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Volume fc8f6353-8150-459e-bf3b-fe11b91c9ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8', 'volume_size': 2} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4dfd4536-5ff0-46b2-94df-e46d6e639d3c tempest-VolumesSnapshotNegativeTestJSON-2033355361 None] Lock "cinder-cb61ea2a-13ae-43bb-86e9-a9ad066f2875-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:19 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b" returned: 0 in 0.387s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:19 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06a702c-0cf5-4457-8d84-ee6b345d90a7]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:19 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b Jul 28 16:30:19 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:19 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b" returned: 0 in 0.410s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b /opt/stack/data/cinder/conversion/25bbbc51-e21e-4277-952e-6b0bec59969b.temp_image.2c958fd1-4715-4c57-9612-8c8497342536y0e90xqf.img {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:19 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b /opt/stack/data/cinder/conversion/25bbbc51-e21e-4277-952e-6b0bec59969b.temp_image.2c958fd1-4715-4c57-9612-8c8497342536y0e90xqf.img Jul 28 16:30:19 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:24 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b /opt/stack/data/cinder/conversion/25bbbc51-e21e-4277-952e-6b0bec59969b.temp_image.2c958fd1-4715-4c57-9612-8c8497342536y0e90xqf.img" returned: 0 in 4.971s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b3dfdb-3227-4d0e-a0e1-796304402afb]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:24 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b Jul 28 16:30:24 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:25 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b" returned: 0 in 0.629s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:25 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/conversion/25bbbc51-e21e-4277-952e-6b0bec59969b.temp_image.2c958fd1-4715-4c57-9612-8c8497342536y0e90xqf.img {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:30:25 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Converted 1024.00 MB image at 205.92 MB/s Jul 28 16:30:25 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] 2c958fd1-4715-4c57-9612-8c8497342536 was raw, no need to convert to raw {{(pid=88286) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 28 16:30:35 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=39,cinder:INSERT=18,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:30:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:INSERT=15,cinder:UPDATE=39,cinder:SELECT=38,cinder:DELETE=4 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:41 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:30:41 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:41 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:30:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.024s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Uploaded volume to glance image-id: 2c958fd1-4715-4c57-9612-8c8497342536. {{(pid=88286) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.875s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-353433352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8f6353-8150-459e-bf3b-fe11b91c9ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a57982e84433693a98d8cf4a1db7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:19Z,use_quota=True,user_id='1de503aa821341e68a414bd2c8631ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Creating volume fc8f6353-8150-459e-bf3b-fe11b91c9ff8 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:30:47 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:30:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 2147483648 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:47 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 2147483648 Jul 28 16:30:47 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b26adbf4-91f7-417a-80cd-3f21fbc77bb0 tempest-TestImageHashVerification-1162349938 None] Copy volume to image completed successfully. Jul 28 16:30:48 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-df904a25-1edd-49da-932f-05d6a74cf2de req-65625c41-4ff7-4075-bf16-d752d7c0edc5 tempest-ServerActionsTestOtherA-853999548 None] Terminate volume connection completed successfully. Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-df904a25-1edd-49da-932f-05d6a74cf2de req-65625c41-4ff7-4075-bf16-d752d7c0edc5 tempest-ServerActionsTestOtherA-853999548 None] Deleting attachment b7c976b9-ce80-4bce-9031-dfb54770a25c. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:30:48 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 2147483648" returned: 0 in 0.718s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:48 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 Jul 28 16:30:48 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:48 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8" returned: 0 in 0.392s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a42c2e-1ef4-4112-899e-067b9daee90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8', 'volume_size': 2}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f67faa-4c78-41c0-8dab-0d6c4a601c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:48 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Volume volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 (fc8f6353-8150-459e-bf3b-fe11b91c9ff8): created successfully Jul 28 16:30:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f67faa-4c78-41c0-8dab-0d6c4a601c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Flow 'volume_create_manager' (5e9cbd6a-a381-43cc-b418-0cd0b141c1aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d031f4a1-a8db-48d8-8452-24e09d47fb30 tempest-VolumesCloneNegativeTest-992831103 None] Created volume successfully. Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Acquiring lock "cinder-25bbbc51-e21e-4277-952e-6b0bec59969b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Lock "cinder-25bbbc51-e21e-4277-952e-6b0bec59969b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Acquiring lock "cinder-quobyte-25bbbc51-e21e-4277-952e-6b0bec59969b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Lock "cinder-quobyte-25bbbc51-e21e-4277-952e-6b0bec59969b" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9195ba7-99ea-4487-90cc-ce1a1790e713]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:49 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b Jul 28 16:30:49 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Acquiring lock "cinder-fc8f6353-8150-459e-bf3b-fe11b91c9ff8-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:49 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b" returned: 0 in 0.461s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Lock "cinder-fc8f6353-8150-459e-bf3b-fe11b91c9ff8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:49 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b Jul 28 16:30:49 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Acquiring lock "cinder-quobyte-fc8f6353-8150-459e-bf3b-fe11b91c9ff8" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Lock "cinder-quobyte-fc8f6353-8150-459e-bf3b-fe11b91c9ff8" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84ca2bb-1af3-4f46-a7d8-bec8ab04f3e4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:50 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 Jul 28 16:30:50 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:50 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-25bbbc51-e21e-4277-952e-6b0bec59969b" returned: 0 in 0.345s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Lock "cinder-quobyte-25bbbc51-e21e-4277-952e-6b0bec59969b" released by "delete_volume" :: held 0.870s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Created reservations ['2159ddcf-8fa9-49a1-891a-dcffdf4d0365', 'a50347fe-ecf3-46da-ab88-0b1845694042', 'bcde7986-6105-41e2-af60-d8d29d321c99', '19877556-c107-4d11-bbe6-e79b43834d23'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:50 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:30:50 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:50 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8" returned: 0 in 0.634s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:50 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8 Jul 28 16:30:50 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:50 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.372s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:30:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Deleted volume successfully. Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f63476ca-cdf2-463e-985d-57e991aa666b tempest-TestImageHashVerification-1162349938 None] Lock "cinder-25bbbc51-e21e-4277-952e-6b0bec59969b-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:50 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fc8f6353-8150-459e-bf3b-fe11b91c9ff8" returned: 0 in 0.397s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Lock "cinder-quobyte-fc8f6353-8150-459e-bf3b-fe11b91c9ff8" released by "delete_volume" :: held 1.092s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Created reservations ['46377b9d-dc11-435e-be34-a0815b6427cd', '80b06834-5468-4c27-9083-2f294b30442c', '6bdddcae-5bc7-47b6-9acb-54fb7ca69905', '9344ab85-17e6-4c45-a1b7-43d87de72fe2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:51 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:30:51 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:51 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:30:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Deleted volume successfully. Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Acquiring lock "cinder-f402f90a-b6d8-4cf9-b314-ac3c094c0a66-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-61ad971a-188a-4914-b9e6-866b68c97251 tempest-VolumesCloneNegativeTest-992831103 None] Lock "cinder-fc8f6353-8150-459e-bf3b-fe11b91c9ff8-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Lock "cinder-f402f90a-b6d8-4cf9-b314-ac3c094c0a66-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Acquiring lock "cinder-quobyte-f402f90a-b6d8-4cf9-b314-ac3c094c0a66" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Lock "cinder-quobyte-f402f90a-b6d8-4cf9-b314-ac3c094c0a66" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e22ec2e-35af-466e-a02a-a7a06399a549]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:30:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:51 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 Jul 28 16:30:51 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:52 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:52 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66 Jul 28 16:30:52 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:52 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Flow 'volume_create_manager' (6f41e60c-8e37-4751-b102-d6c6c387f047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf25ffa-0863-4d1b-a971-22f1fa764143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f402f90a-b6d8-4cf9-b314-ac3c094c0a66" returned: 0 in 0.479s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf25ffa-0863-4d1b-a971-22f1fa764143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-573354326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a402fa1-000d-4cfc-998c-fa956aedafe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852b8e6447846bcbb88716921c9d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:52Z,use_quota=True,user_id='acbc424fae41496c8ffbfcf2c5adcbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71111ce1-a6b9-4981-9f2d-7e8202adb895),volume_type_id=71111ce1-a6b9-4981-9f2d-7e8202adb895)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487d5785-0645-4721-9aa9-28b15794fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487d5785-0645-4721-9aa9-28b15794fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf3aae6-c02c-4ae8-87fa-3480fa1db0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf3aae6-c02c-4ae8-87fa-3480fa1db0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a402fa1-000d-4cfc-998c-fa956aedafe9', 'volume_name': 'volume-0a402fa1-000d-4cfc-998c-fa956aedafe9', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cab15ff-a5fa-48e4-ab06-dc778024fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cab15ff-a5fa-48e4-ab06-dc778024fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1872d5c-fe58-434b-b04c-9b8a97e6ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Volume 0a402fa1-000d-4cfc-998c-fa956aedafe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a402fa1-000d-4cfc-998c-fa956aedafe9', 'volume_size': 1} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-573354326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a402fa1-000d-4cfc-998c-fa956aedafe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852b8e6447846bcbb88716921c9d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:52Z,use_quota=True,user_id='acbc424fae41496c8ffbfcf2c5adcbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71111ce1-a6b9-4981-9f2d-7e8202adb895),volume_type_id=71111ce1-a6b9-4981-9f2d-7e8202adb895)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Creating volume 0a402fa1-000d-4cfc-998c-fa956aedafe9 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:30:52 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Lock "cinder-quobyte-f402f90a-b6d8-4cf9-b314-ac3c094c0a66" released by "delete_volume" :: held 1.129s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:52 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 1073741824 Jul 28 16:30:52 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:52 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Created reservations ['d351f5cb-17df-40f5-9744-125c43331558', 'f30c7f03-71c1-49be-be24-5b02bec2c40e', '39566307-6c89-46ca-8621-f9d02aa0cd29', 'f2339872-210a-4800-96c9-5b63ada2a04e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:53 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:30:53 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Flow 'volume_create_manager' (3f9d084b-a656-4028-bb60-4e56dc4458cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d8e01f-079a-4119-86ca-b5562afac18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d8e01f-079a-4119-86ca-b5562afac18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-862404689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e645096-5964-4d13-a38e-b2c0cb0d2e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852b8e6447846bcbb88716921c9d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:53Z,use_quota=True,user_id='acbc424fae41496c8ffbfcf2c5adcbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8179d248-b925-44f8-8e38-32b068831709),volume_type_id=8179d248-b925-44f8-8e38-32b068831709)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3815aca4-d14b-42a1-a460-f163ca81acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3815aca4-d14b-42a1-a460-f163ca81acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae008c1e-b927-4cbd-901a-4ae819afb4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae008c1e-b927-4cbd-901a-4ae819afb4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e645096-5964-4d13-a38e-b2c0cb0d2e9d', 'volume_name': 'volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bfa183-d168-4163-bea9-8d524266a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bfa183-d168-4163-bea9-8d524266a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f8bc6d-33de-448f-9567-e05a75a73095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Volume 4e645096-5964-4d13-a38e-b2c0cb0d2e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d', 'volume_size': 1} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:53 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 1073741824" returned: 0 in 0.795s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:53 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.462s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:30:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Deleted volume successfully. Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-02fcbd6a-4f18-4bd9-8e8c-c3ef6959c18b tempest-ServerActionsTestOtherA-853999548 None] Lock "cinder-f402f90a-b6d8-4cf9-b314-ac3c094c0a66-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:53 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 Jul 28 16:30:53 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:53 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9" returned: 0 in 0.395s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-862404689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e645096-5964-4d13-a38e-b2c0cb0d2e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852b8e6447846bcbb88716921c9d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:53Z,use_quota=True,user_id='acbc424fae41496c8ffbfcf2c5adcbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8179d248-b925-44f8-8e38-32b068831709),volume_type_id=8179d248-b925-44f8-8e38-32b068831709)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Creating volume 4e645096-5964-4d13-a38e-b2c0cb0d2e9d {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:30:54 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:54 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d 1073741824 Jul 28 16:30:54 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1872d5c-fe58-434b-b04c-9b8a97e6ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a402fa1-000d-4cfc-998c-fa956aedafe9', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ed36b9-c495-46a6-aeb8-9bae6763537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:54 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Volume volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 (0a402fa1-000d-4cfc-998c-fa956aedafe9): created successfully Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ed36b9-c495-46a6-aeb8-9bae6763537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Flow 'volume_create_manager' (6f41e60c-8e37-4751-b102-d6c6c387f047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b07ee7a4-57f1-486a-b2a8-bd3ab267ae52 tempest-TestInstancesWithCinderVolumes-331355615 None] Created volume successfully. Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Flow 'volume_create_manager' (b48486d0-24a7-4154-a827-24fe42b83c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41855c4-9911-4d00-8f9d-869c2b48fac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41855c4-9911-4d00-8f9d-869c2b48fac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-781971157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db56f670-fed0-4fbd-95ad-258dac553436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852b8e6447846bcbb88716921c9d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:54Z,use_quota=True,user_id='acbc424fae41496c8ffbfcf2c5adcbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1475b698-a180-4feb-90a3-90858d2868d0),volume_type_id=1475b698-a180-4feb-90a3-90858d2868d0)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6d8e57-ccfc-4201-adf8-fd28e17df9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6d8e57-ccfc-4201-adf8-fd28e17df9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe1c102-7eff-4391-ba96-2603b2dca787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:30:54 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d 1073741824" returned: 0 in 0.931s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:55 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d Jul 28 16:30:55 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:55 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d" returned: 0 in 0.453s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f8bc6d-33de-448f-9567-e05a75a73095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee8917f-8de6-4d50-845c-e632dd3f86f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:55 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Volume volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d (4e645096-5964-4d13-a38e-b2c0cb0d2e9d): created successfully Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee8917f-8de6-4d50-845c-e632dd3f86f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Flow 'volume_create_manager' (3f9d084b-a656-4028-bb60-4e56dc4458cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe1c102-7eff-4391-ba96-2603b2dca787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db56f670-fed0-4fbd-95ad-258dac553436', 'volume_name': 'volume-db56f670-fed0-4fbd-95ad-258dac553436', 'volume_size': 1, 'image_id': '98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--309677285', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9852b8e6447846bcbb88716921c9d889', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'created_at': datetime.datetime(2026, 7, 28, 14, 30, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 30, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6/file', 'properties': {}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934d082d-95ea-48c2-9bb2-d2ab79ebb17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934d082d-95ea-48c2-9bb2-d2ab79ebb17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a6c589-fad0-44aa-bf74-4c41a07984f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:55 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Volume db56f670-fed0-4fbd-95ad-258dac553436: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db56f670-fed0-4fbd-95ad-258dac553436', 'volume_size': 1, 'image_id': '98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--309677285', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9852b8e6447846bcbb88716921c9d889', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'created_at': datetime.datetime(2026, 7, 28, 14, 30, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 30, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6/file', 'properties': {}}, 'image_service': } Jul 28 16:30:55 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Trying to clone db56f670-fed0-4fbd-95ad-258dac553436 from image 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:30:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-56b82d48-50f8-4056-9842-0fabcff36cbf tempest-TestInstancesWithCinderVolumes-331355615 None] Created volume successfully. Jul 28 16:30:57 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:30:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (5d515872-6589-4cc0-a413-a72defaf2902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7fb607-faa2-41d9-b5cc-dfb20fed845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7fb607-faa2-41d9-b5cc-dfb20fed845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-478692697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf0f257-ae65-4e4a-8da3-80ae59ad9b11,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:58Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e9c67d-6b0d-446f-8757-de6a9ff0c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e9c67d-6b0d-446f-8757-de6a9ff0c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7c5166-e531-4f0f-845e-6c0c02767068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7c5166-e531-4f0f-845e-6c0c02767068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf0f257-ae65-4e4a-8da3-80ae59ad9b11', 'volume_name': 'volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7902cae-e6f1-4ff0-811b-f7c613d90e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7902cae-e6f1-4ff0-811b-f7c613d90e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58685641-7864-4ada-b448-109101808d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:58 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Volume bdf0f257-ae65-4e4a-8da3-80ae59ad9b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11', 'volume_size': 1} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-478692697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf0f257-ae65-4e4a-8da3-80ae59ad9b11,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:58Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Creating volume bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:30:58 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:58 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 1073741824 Jul 28 16:30:58 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:58 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 1073741824" returned: 0 in 0.674s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:30:58 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 Jul 28 16:30:58 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:30:59 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 28 16:30:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11" returned: 0 in 0.297s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:30:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:30:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:30:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58685641-7864-4ada-b448-109101808d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af98379-3685-4b98-9013-e31abff61ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:30:59 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Volume volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 (bdf0f257-ae65-4e4a-8da3-80ae59ad9b11): created successfully Jul 28 16:30:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af98379-3685-4b98-9013-e31abff61ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:30:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (5d515872-6589-4cc0-a413-a72defaf2902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:30:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-948e1707-4a55-4ff7-b0b3-0d590e5b3918 tempest-VolumesGetTest-1293147614 None] Created volume successfully. Jul 28 16:31:00 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:31:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (b88646dd-f9f7-4223-a86c-1df6cd2050f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeafd55d-112d-4c61-8f19-2a53399d6496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeafd55d-112d-4c61-8f19-2a53399d6496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-735770623',display_name='tempest-VolumesGetTest-Volume-2746336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45403885-181d-4b04-b44e-0341aa216426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:01Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981f9978-cfeb-4d97-8f49-d3baf275d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981f9978-cfeb-4d97-8f49-d3baf275d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc2671a-0781-4af9-8020-756cb7e6b6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc2671a-0781-4af9-8020-756cb7e6b6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45403885-181d-4b04-b44e-0341aa216426', 'volume_name': 'volume-45403885-181d-4b04-b44e-0341aa216426', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5feaf-b6a7-42e1-ae15-d890c0de61da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5feaf-b6a7-42e1-ae15-d890c0de61da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01012cb1-c86b-4dcd-a248-ea0fb4a54a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Volume 45403885-181d-4b04-b44e-0341aa216426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45403885-181d-4b04-b44e-0341aa216426', 'volume_size': 1} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-735770623',display_name='tempest-VolumesGetTest-Volume-2746336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45403885-181d-4b04-b44e-0341aa216426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:01Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Creating volume 45403885-181d-4b04-b44e-0341aa216426 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:31:01 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:01 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 1073741824 Jul 28 16:31:01 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD, size 20.69 MB, duration 5.42 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:31:01 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Image download 20.69 MB at 3.82 MB/s Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b319b-2b0d-4cc7-9f14-cf16b0997203]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:01 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD Jul 28 16:31:01 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:01 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Temporary image 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 is fetched for user acbc424fae41496c8ffbfcf2c5adcbda. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:31:01 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 1073741824" returned: 0 in 0.610s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[29527bca-d504-4247-b980-e795cace9687]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:01 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 Jul 28 16:31:01 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:01 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD Jul 28 16:31:01 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:02 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426" returned: 0 in 0.467s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01012cb1-c86b-4dcd-a248-ea0fb4a54a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45403885-181d-4b04-b44e-0341aa216426', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f1a31e-9fb5-4217-a451-b8127fe54b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:02 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Volume volume-45403885-181d-4b04-b44e-0341aa216426 (45403885-181d-4b04-b44e-0341aa216426): created successfully Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f1a31e-9fb5-4217-a451-b8127fe54b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:02 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (b88646dd-f9f7-4223-a86c-1df6cd2050f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-781971157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db56f670-fed0-4fbd-95ad-258dac553436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852b8e6447846bcbb88716921c9d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:30:54Z,use_quota=True,user_id='acbc424fae41496c8ffbfcf2c5adcbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1475b698-a180-4feb-90a3-90858d2868d0),volume_type_id=1475b698-a180-4feb-90a3-90858d2868d0)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Creating volume db56f670-fed0-4fbd-95ad-258dac553436 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:31:02 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6c499531-ffc9-4083-9649-d3b7c12d6a2b tempest-VolumesGetTest-1293147614 None] Created volume successfully. Jul 28 16:31:02 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 1073741824 Jul 28 16:31:02 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:02 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 1073741824" returned: 0 in 0.518s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:02 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 Jul 28 16:31:02 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-45403885-181d-4b04-b44e-0341aa216426-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:03 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Lock "cinder-45403885-181d-4b04-b44e-0341aa216426-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Attempting download of 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'metadata': {}}])) to volume db56f670-fed0-4fbd-95ad-258dac553436. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-45403885-181d-4b04-b44e-0341aa216426" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[70136cb6-c4d8-4458-a9a6-81d09d9db123]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_dicas1fc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-45403885-181d-4b04-b44e-0341aa216426" acquired by "delete_volume" :: waited 0.051s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ef15da-7f7c-4b12-83ec-a242a7c3a23c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:03 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_dicas1fc Jul 28 16:31:03 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:03 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 Jul 28 16:31:03 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:03 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_dicas1fc" returned: 0 in 0.485s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_dicas1fc {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:04 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426" returned: 0 in 0.582s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:04 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_dicas1fc Jul 28 16:31:04 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:04 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426 Jul 28 16:31:04 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:04 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-45403885-181d-4b04-b44e-0341aa216426" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:04 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-45403885-181d-4b04-b44e-0341aa216426" released by "delete_volume" :: held 1.019s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_dicas1fc" returned: 1 in 0.551s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_dicas1fc' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b463480-e7a2-432e-8945-a65126c32669]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:04 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD Jul 28 16:31:04 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Created reservations ['e6fd7c41-da6e-485a-b0f2-4c2c49b61234', 'f690b081-9d6f-417d-9f4b-68e7612c9a69', '6e0b6302-f2e6-45e3-b4eb-6739ace5ca8d', '67984dbf-717f-46ff-a77d-3e58ae9c511b'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:04 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:04 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:04 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 was qcow2, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:31:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:05 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 Jul 28 16:31:05 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:05 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.389s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Deleted volume successfully. Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54adb9b6-9c2a-4327-867a-dcd7ceddaf63 tempest-VolumesGetTest-1293147614 None] Lock "cinder-45403885-181d-4b04-b44e-0341aa216426-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Lock "cinder-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da3e963-938d-4a54-a4ee-625c7beba1ee]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:06 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 Jul 28 16:31:06 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:06 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11" returned: 0 in 0.552s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:06 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11 Jul 28 16:31:06 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:06 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11" returned: 0 in 0.389s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11" released by "delete_volume" :: held 0.987s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:06 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Created reservations ['8e12ce6a-537c-4cf6-b625-6c19b112ad5c', 'f90b3493-5b64-4b2e-960f-f233e1109467', 'b85dc961-07df-4932-9ae3-f66e839f76cf', '65619bdf-a44c-4522-adb9-c37c58a7ff94'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:07 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:07 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:07 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Deleted volume successfully. Jul 28 16:31:07 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436" returned: 0 in 2.486s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_98b4514d-1a62-4743-b1a0-6148d6c2d5a6_zlbk40abdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:31:07 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Converted 112.00 MB image at 45.03 MB/s Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b7ffe21d-3258-43dd-837e-e57a0b4938b5 tempest-VolumesGetTest-1293147614 None] Lock "cinder-bdf0f257-ae65-4e4a-8da3-80ae59ad9b11-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:07 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 1G Jul 28 16:31:07 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:07 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 1G" returned: 0 in 0.367s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Downloaded image 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'metadata': {}}])) to volume db56f670-fed0-4fbd-95ad-258dac553436 successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Temporary image 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 for user acbc424fae41496c8ffbfcf2c5adcbda is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Marking volume db56f670-fed0-4fbd-95ad-258dac553436 as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Copying metadata from image 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 to db56f670-fed0-4fbd-95ad-258dac553436. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Creating volume glance metadata for volume db56f670-fed0-4fbd-95ad-258dac553436 backed by image 98b4514d-1a62-4743-b1a0-6148d6c2d5a6 with: {'image_id': '98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'image_name': 'tempest-scenario-img--309677285', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a6c589-fad0-44aa-bf74-4c41a07984f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db56f670-fed0-4fbd-95ad-258dac553436', 'volume_size': 1, 'image_id': '98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--309677285', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9852b8e6447846bcbb88716921c9d889', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98b4514d-1a62-4743-b1a0-6148d6c2d5a6', 'created_at': datetime.datetime(2026, 7, 28, 14, 30, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 30, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98b4514d-1a62-4743-b1a0-6148d6c2d5a6/file', 'properties': {}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1b230b-21d0-4b54-969d-5f46b7265e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Volume volume-db56f670-fed0-4fbd-95ad-258dac553436 (db56f670-fed0-4fbd-95ad-258dac553436): created successfully Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1b230b-21d0-4b54-969d-5f46b7265e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Flow 'volume_create_manager' (b48486d0-24a7-4154-a827-24fe42b83c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-24c43b8d-9964-4185-83a2-62cca823ff56 tempest-TestInstancesWithCinderVolumes-331355615 None] Created volume successfully. Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (9bfb285a-fb7c-4f36-821e-97e6b6de4a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f84da7-1593-46e0-983f-0e3967690b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f84da7-1593-46e0-983f-0e3967690b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-995131881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1a7fd7-a9e9-402a-ae69-b193990e0b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:09Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cd0593-e446-4cf1-b62b-8d2685614b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cd0593-e446-4cf1-b62b-8d2685614b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c70479c-29dc-40de-bfa9-9bdfb8c39adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c70479c-29dc-40de-bfa9-9bdfb8c39adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1a7fd7-a9e9-402a-ae69-b193990e0b5c', 'volume_name': 'volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2be2f65-445a-4ca1-b5b0-5e76deabc9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2be2f65-445a-4ca1-b5b0-5e76deabc9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf387256-2d98-45e8-88e9-6bf293823323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Volume 6a1a7fd7-a9e9-402a-ae69-b193990e0b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c', 'volume_size': 1} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-995131881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1a7fd7-a9e9-402a-ae69-b193990e0b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:09Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Creating volume 6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:31:08 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:31:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:08 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c 1073741824 Jul 28 16:31:08 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:09 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c 1073741824" returned: 0 in 0.662s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:09 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c Jul 28 16:31:09 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:09 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" returned: 0 in 0.368s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:31:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf387256-2d98-45e8-88e9-6bf293823323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030c1e54-76fb-408c-ab27-4d5653759306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Volume volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c (6a1a7fd7-a9e9-402a-ae69-b193990e0b5c): created successfully Jul 28 16:31:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030c1e54-76fb-408c-ab27-4d5653759306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (9bfb285a-fb7c-4f36-821e-97e6b6de4a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-61d4e91d-01dc-4703-b7b1-25af0ed97a5f tempest-VolumesGetTest-1293147614 None] Created volume successfully. Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (8bf5a9b1-7acd-4796-8633-89402a0bcfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0fb125-6770-43ab-87fa-432a89a0db38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0fb125-6770-43ab-87fa-432a89a0db38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1029590356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37fda9c-f10e-4864-8b1f-e43d4df4369b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6a1a7fd7-a9e9-402a-ae69-b193990e0b5c,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:11Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe4f155-a12b-4c49-a956-097ac0b19007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe4f155-a12b-4c49-a956-097ac0b19007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aebcb50-940e-43bb-a040-dee3266cd262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aebcb50-940e-43bb-a040-dee3266cd262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e37fda9c-f10e-4864-8b1f-e43d4df4369b', 'volume_name': 'volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b', 'volume_size': 1, 'source_volid': '6a1a7fd7-a9e9-402a-ae69-b193990e0b5c', 'source_volstatus': 'available'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d250a8e-0265-4c94-81f4-8297bf9340dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d250a8e-0265-4c94-81f4-8297bf9340dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ead559-0b43-4ea4-9891-af81a1aaf850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:11 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Volume e37fda9c-f10e-4864-8b1f-e43d4df4369b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b', 'volume_size': 1, 'source_volid': '6a1a7fd7-a9e9-402a-ae69-b193990e0b5c', 'source_volstatus': 'available'} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:11 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Cloning volume 6a1a7fd7-a9e9-402a-ae69-b193990e0b5c to volume e37fda9c-f10e-4864-8b1f-e43d4df4369b Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Creating offline snapshot 181bc5fd-8b6a-4505-bb70-91829f0700b4 of volume 6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1181dc60-7cce-449f-b9a8-2b39e54f1231]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:11 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c Jul 28 16:31:11 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:12 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:12 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 1G Jul 28 16:31:12 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:12 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 1G" returned: 0 in 0.522s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:12 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 Jul 28 16:31:12 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:12 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4" returned: 0 in 0.360s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:12 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 is being set with open permissions: ugo+rw Jul 28 16:31:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:13 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 Jul 28 16:31:13 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:13 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4" returned: 0 in 0.335s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:13 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.info Jul 28 16:31:13 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:13 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.info" returned: 0 in 0.305s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:13 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.info is being set with open permissions: ugo+rw Jul 28 16:31:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:13 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.info Jul 28 16:31:13 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:14 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.info" returned: 0 in 0.359s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-e37fda9c-f10e-4864-8b1f-e43d4df4369b" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-e37fda9c-f10e-4864-8b1f-e43d4df4369b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] snapshot: 181bc5fd-8b6a-4505-bb70-91829f0700b4, volume: e37fda9c-f10e-4864-8b1f-e43d4df4369b, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb01bb1-b202-4ca3-bfda-1f6c2c8c1379]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:14 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 Jul 28 16:31:14 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:14 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4" returned: 0 in 0.419s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d96e18-7840-42b1-a3f1-ae6df5a9914d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:14 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c Jul 28 16:31:14 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:14 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" returned: 0 in 0.448s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:15 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:31:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:15 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b Jul 28 16:31:15 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b" returned: 0 in 6.503s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a1cce-6dd8-4dfe-ab55-93e10cbfd75e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:21 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c Jul 28 16:31:21 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:22 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" returned: 0 in 0.969s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:31:22 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Converted 1024.00 MB image at 157.44 MB/s Jul 28 16:31:22 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b is being set with open permissions: ugo+rw Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-4cb6b7b0-1e29-46ac-b6f2-da54784638b1 req-122403b9-898c-468b-a456-511a2f4363a5 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:22 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b Jul 28 16:31:22 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:22 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-e37fda9c-f10e-4864-8b1f-e43d4df4369b" released by "_copy_volume_from_snapshot" :: held 8.780s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-181bc5fd-8b6a-4505-bb70-91829f0700b4" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-181bc5fd-8b6a-4505-bb70-91829f0700b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Deleting offline snapshot 181bc5fd-8b6a-4505-bb70-91829f0700b4 of volume 6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] snapshot_file for this snap is: volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc818a-b190-4dcf-a0e8-27874b068a71]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:23 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 Jul 28 16:31:23 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:23 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4" returned: 0 in 0.455s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:31:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d9e36-fff4-453f-a89a-f2cdee3702ab]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:23 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c Jul 28 16:31:23 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:24 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" returned: 0 in 0.604s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:24 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 Jul 28 16:31:24 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:24 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4" returned: 0 in 0.648s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:24 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4 Jul 28 16:31:24 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:25 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c.181bc5fd-8b6a-4505-bb70-91829f0700b4" returned: 0 in 0.358s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-181bc5fd-8b6a-4505-bb70-91829f0700b4" released by "_delete_snapshot" :: held 2.222s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.549s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-4cb6b7b0-1e29-46ac-b6f2-da54784638b1 req-122403b9-898c-468b-a456-511a2f4363a5 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.621s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-4cb6b7b0-1e29-46ac-b6f2-da54784638b1 req-122403b9-898c-468b-a456-511a2f4363a5 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ead559-0b43-4ea4-9891-af81a1aaf850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b', 'volume_size': 1, 'source_volid': '6a1a7fd7-a9e9-402a-ae69-b193990e0b5c', 'source_volstatus': 'available'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ffd6d1-d450-4c87-b5ed-163aae7c6949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:25 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Volume volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b (e37fda9c-f10e-4864-8b1f-e43d4df4369b): created successfully Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ffd6d1-d450-4c87-b5ed-163aae7c6949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (8bf5a9b1-7acd-4796-8633-89402a0bcfe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-4cb6b7b0-1e29-46ac-b6f2-da54784638b1 req-122403b9-898c-468b-a456-511a2f4363a5 tempest-TestInstancesWithCinderVolumes-331355615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-db56f670-fed0-4fbd-95ad-258dac553436', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1698f17c-96c8-4967-988d-8d252e18bd59', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:31:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8f8a4dce-162f-4e09-af09-8fda7b24baf7 tempest-VolumesGetTest-1293147614 None] Created volume successfully. Jul 28 16:31:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-4cb6b7b0-1e29-46ac-b6f2-da54784638b1 req-122403b9-898c-468b-a456-511a2f4363a5 tempest-TestInstancesWithCinderVolumes-331355615 None] attachment_update completed successfully. Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (87341d21-8a4c-4de2-b402-962538d38dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b75d3a-3730-4eb8-94cc-09815f711d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b75d3a-3730-4eb8-94cc-09815f711d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1415530900',display_name='tempest-VolumesGetTest-Volume-501469298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c946f612-5fb6-4b27-bcee-c0c03c8d5610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:27Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d526e80-9385-4cce-9304-aada4bd88f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d526e80-9385-4cce-9304-aada4bd88f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c491c24e-f2c1-4afb-9165-34276b2da604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c491c24e-f2c1-4afb-9165-34276b2da604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c946f612-5fb6-4b27-bcee-c0c03c8d5610', 'volume_name': 'volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fb204c-a5ab-48f5-8464-640df5b886d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fb204c-a5ab-48f5-8464-640df5b886d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec02ca-84d7-46fd-bfd3-a34c71576077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:27 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Volume c946f612-5fb6-4b27-bcee-c0c03c8d5610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610', 'volume_size': 1} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1415530900',display_name='tempest-VolumesGetTest-Volume-501469298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c946f612-5fb6-4b27-bcee-c0c03c8d5610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:27Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Creating volume c946f612-5fb6-4b27-bcee-c0c03c8d5610 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:31:27 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:27 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 1073741824 Jul 28 16:31:27 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:27 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 1073741824" returned: 0 in 0.627s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:27 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 Jul 28 16:31:27 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:28 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610" returned: 0 in 0.374s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:31:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec02ca-84d7-46fd-bfd3-a34c71576077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8a662c-7595-4aa0-bc22-f12bd3c2636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:28 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Volume volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 (c946f612-5fb6-4b27-bcee-c0c03c8d5610): created successfully Jul 28 16:31:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8a662c-7595-4aa0-bc22-f12bd3c2636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (87341d21-8a4c-4de2-b402-962538d38dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-78424506-007a-44f0-af7a-4891abcf116b tempest-VolumesGetTest-1293147614 None] Created volume successfully. Jul 28 16:31:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-c946f612-5fb6-4b27-bcee-c0c03c8d5610-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Lock "cinder-c946f612-5fb6-4b27-bcee-c0c03c8d5610-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-c946f612-5fb6-4b27-bcee-c0c03c8d5610" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-c946f612-5fb6-4b27-bcee-c0c03c8d5610" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ea049-9da7-4c48-b5cb-9925b2f34ece]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:29 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 Jul 28 16:31:29 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:30 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:30 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610 Jul 28 16:31:30 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:30 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c946f612-5fb6-4b27-bcee-c0c03c8d5610" returned: 0 in 0.390s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-c946f612-5fb6-4b27-bcee-c0c03c8d5610" released by "delete_volume" :: held 0.970s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Created reservations ['d72e3c83-6fc0-479a-8848-2e652e76f0a8', '90a89f5d-7087-438d-8cdf-b830f368a8e3', '465e038e-aafd-4fb2-9189-3055efea521f', 'db982a48-37a1-4c63-a554-96e9fb1cfb33'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:30 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:30 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:31 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.270s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:31 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Deleted volume successfully. Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff037b6e-3570-4201-b3f0-b55c4239c431 tempest-VolumesGetTest-1293147614 None] Lock "cinder-c946f612-5fb6-4b27-bcee-c0c03c8d5610-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-e37fda9c-f10e-4864-8b1f-e43d4df4369b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Lock "cinder-e37fda9c-f10e-4864-8b1f-e43d4df4369b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-e37fda9c-f10e-4864-8b1f-e43d4df4369b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-e37fda9c-f10e-4864-8b1f-e43d4df4369b" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[31395e2f-2119-4cbc-9dad-291de31cad59]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:32 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b Jul 28 16:31:32 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:32 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:32 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b Jul 28 16:31:32 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:32 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e37fda9c-f10e-4864-8b1f-e43d4df4369b" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-e37fda9c-f10e-4864-8b1f-e43d4df4369b" released by "delete_volume" :: held 0.834s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Created reservations ['d80dee77-062d-422d-8a22-cd2ec53ccaaf', '0f3aeefb-da75-4950-ac20-0f74750fbf30', '8e12728d-bf5d-4251-a60a-2de4b5a45e04', '4d6a3f42-e9b5-40ed-b286-4a0f732f3010'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:32 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:32 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Lock "cinder-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:33 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.468s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Deleted volume successfully. Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[791ab3c1-ab82-41c0-b5eb-eb64fc722cca]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0884db32-392e-42ef-b6e7-f7419d2e2159 tempest-VolumesGetTest-1293147614 None] Lock "cinder-e37fda9c-f10e-4864-8b1f-e43d4df4369b-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:33 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c Jul 28 16:31:33 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:33 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" returned: 0 in 0.466s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:33 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c Jul 28 16:31:33 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:34 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" returned: 0 in 0.297s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c" released by "delete_volume" :: held 0.848s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Created reservations ['cdab4706-074a-440a-821f-cda72c4c0b0c', '011aa0c2-8463-4a44-904a-cee79166d568', 'd898bbfa-31f6-46b3-b4d5-44eddc5b9728', '2034e176-9cdd-4b64-978d-8ff66abcd1ca'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:34 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:34 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:34 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.372s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:34 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Deleted volume successfully. Jul 28 16:31:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f5e0524d-4d7a-472c-bc4b-e8212f4001a8 tempest-VolumesGetTest-1293147614 None] Lock "cinder-6a1a7fd7-a9e9-402a-ae69-b193990e0b5c-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (ff3892b5-ea7b-4be2-a0d7-5d218bbb921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05fd3f7-1a42-48f9-8c14-c8bc1edf90e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05fd3f7-1a42-48f9-8c14-c8bc1edf90e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1776653964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5192f8c-56d4-47bb-9ea3-a5d94523c7bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:35Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110b668f-988a-4d59-96c3-7e2896da7389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110b668f-988a-4d59-96c3-7e2896da7389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dc1db0-2b89-4ce2-84dd-a810912162b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:35 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dc1db0-2b89-4ce2-84dd-a810912162b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5192f8c-56d4-47bb-9ea3-a5d94523c7bb', 'volume_name': 'volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0534778-243e-44ee-abd6-23aa7f06d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0534778-243e-44ee-abd6-23aa7f06d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cff2d6f-4cfd-43c5-b8a7-a73c1ae4e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:36 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Volume d5192f8c-56d4-47bb-9ea3-a5d94523c7bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Trying to clone d5192f8c-56d4-47bb-9ea3-a5d94523c7bb from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:31:36 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Image download 20.69 MB at 20.69 MB/s Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1cc902-7f81-4ced-a0c7-3b358832f627]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:36 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD Jul 28 16:31:36 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:37 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 is fetched for user 548fb75161c94b59860e3a14cfd84949. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2165ee-db1b-4a2b-8a5d-c91869e58333]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:37 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD Jul 28 16:31:37 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:37 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1776653964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5192f8c-56d4-47bb-9ea3-a5d94523c7bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:35Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Creating volume d5192f8c-56d4-47bb-9ea3-a5d94523c7bb {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:31:37 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:31:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:38 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb 1073741824 Jul 28 16:31:38 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:39 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb 1073741824" returned: 0 in 1.215s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:39 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb Jul 28 16:31:39 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:39 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb" returned: 0 in 0.566s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:31:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:39 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Attempting download of 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume d5192f8c-56d4-47bb-9ea3-a5d94523c7bb. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:31:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[59779832-5550-41b7-9d19-fe1240bb8386]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_0xyrjk5s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:40 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_0xyrjk5s Jul 28 16:31:40 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:40 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_0xyrjk5s" returned: 0 in 0.578s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_0xyrjk5s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:40 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_0xyrjk5s Jul 28 16:31:40 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:41 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:41 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:41 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_0xyrjk5s" returned: 1 in 0.620s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_0xyrjk5s' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5e6a3-e04f-4abb-a0db-2c879dcbd767]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:41 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD Jul 28 16:31:41 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:41 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.549s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:31:41 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] 80bdb979-36ce-4750-96f5-dc31bfd10d53 was qcow2, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:31:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:41 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb Jul 28 16:31:41 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Flow 'volume_create_manager' (2a0d03c2-9bd9-4a82-ad76-8369703e2067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea4298-6fdb-4b9f-a129-64f558cef790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea4298-6fdb-4b9f-a129-64f558cef790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-73734186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a1aa57-ea1d-4c55-acd8-31f44627bff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9eeba736cb94ade900299245867df92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:44Z,use_quota=True,user_id='9b32e6713c8c4575b97e22ea23b3144e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e03128b-d1b9-4cf4-ae6d-4da84a6339a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e03128b-d1b9-4cf4-ae6d-4da84a6339a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f719847-5e7c-4f51-909c-1df22b722689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f719847-5e7c-4f51-909c-1df22b722689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a1aa57-ea1d-4c55-acd8-31f44627bff3', 'volume_name': 'volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5652aa8-8670-4446-863b-3c707fabfc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5652aa8-8670-4446-863b-3c707fabfc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a82939-6c07-488e-b528-671be864e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Volume f2a1aa57-ea1d-4c55-acd8-31f44627bff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3', 'volume_size': 1} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-73734186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a1aa57-ea1d-4c55-acd8-31f44627bff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9eeba736cb94ade900299245867df92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:44Z,use_quota=True,user_id='9b32e6713c8c4575b97e22ea23b3144e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Creating volume f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:31:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:31:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:44 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 1073741824 Jul 28 16:31:44 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:45 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb" returned: 0 in 3.760s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:45 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_zq8ryqhkdevstack@QuobyteHD, size 112.00 MB, duration 3.77 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:31:45 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Converted 112.00 MB image at 29.70 MB/s Jul 28 16:31:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:45 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 1073741824" returned: 0 in 1.069s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:45 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb 1G Jul 28 16:31:45 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:45 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=84,cinder:UPDATE=107,cinder:INSERT=24,cinder:DELETE=7 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:31:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:45 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 Jul 28 16:31:45 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:46 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb 1G" returned: 0 in 0.669s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Downloaded image 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume d5192f8c-56d4-47bb-9ea3-a5d94523c7bb successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 for user 548fb75161c94b59860e3a14cfd84949 is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Marking volume d5192f8c-56d4-47bb-9ea3-a5d94523c7bb as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Copying metadata from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 to d5192f8c-56d4-47bb-9ea3-a5d94523c7bb. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Creating volume glance metadata for volume d5192f8c-56d4-47bb-9ea3-a5d94523c7bb backed by image 80bdb979-36ce-4750-96f5-dc31bfd10d53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=92,cinder:SELECT=74,cinder:INSERT=31,cinder:DELETE=10 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:31:46 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" returned: 0 in 0.645s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a82939-6c07-488e-b528-671be864e686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dfb99d-a6a4-4c35-b0e9-c60732216095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Volume volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 (f2a1aa57-ea1d-4c55-acd8-31f44627bff3): created successfully Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dfb99d-a6a4-4c35-b0e9-c60732216095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Flow 'volume_create_manager' (2a0d03c2-9bd9-4a82-ad76-8369703e2067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cff2d6f-4cfd-43c5-b8a7-a73c1ae4e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175c501d-df96-4b47-925e-cf0f0a47e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8cc3dcba-5263-4a83-b93e-75848edf5691 tempest-TestStampPattern-1961021372 None] Created volume successfully. Jul 28 16:31:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Volume volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb (d5192f8c-56d4-47bb-9ea3-a5d94523c7bb): created successfully Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175c501d-df96-4b47-925e-cf0f0a47e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (ff3892b5-ea7b-4be2-a0d7-5d218bbb921e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-16feddfa-a4b5-4a65-9fa4-e89afa5fb2c2 tempest-VolumesGetTest-1293147614 None] Created volume successfully. Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (cebfff3b-959f-49a5-919e-555c75aaec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671f1d35-337b-4a65-83e8-b249e7a43789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671f1d35-337b-4a65-83e8-b249e7a43789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-496546163',display_name='tempest-VolumesGetTest-Volume-59081393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a8c97d-5922-43ba-a551-06dd0927d7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:48Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50dd968a-a2c7-4b96-8505-d8e1f5ef1209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50dd968a-a2c7-4b96-8505-d8e1f5ef1209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ec4da8-3c6d-4c7c-9533-a11a1a976023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ec4da8-3c6d-4c7c-9533-a11a1a976023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a8c97d-5922-43ba-a551-06dd0927d7d3', 'volume_name': 'volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5713f64-4e9b-40cf-b14a-59f5cf804735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5713f64-4e9b-40cf-b14a-59f5cf804735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee79355e-95f8-4e75-958f-ff739095f5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:48 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Volume e6a8c97d-5922-43ba-a551-06dd0927d7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3', 'volume_size': 1} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:31:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-496546163',display_name='tempest-VolumesGetTest-Volume-59081393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a8c97d-5922-43ba-a551-06dd0927d7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d9a3b02c844393a143802e212ba787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:31:48Z,use_quota=True,user_id='548fb75161c94b59860e3a14cfd84949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Creating volume e6a8c97d-5922-43ba-a551-06dd0927d7d3 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:31:48 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:31:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:48 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 1073741824 Jul 28 16:31:48 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:49 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 1073741824" returned: 0 in 0.780s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:49 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 Jul 28 16:31:49 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:50 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3" returned: 0 in 1.135s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:31:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee79355e-95f8-4e75-958f-ff739095f5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf06ddc-737d-4036-8732-c91e5aa811f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:31:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Volume volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 (e6a8c97d-5922-43ba-a551-06dd0927d7d3): created successfully Jul 28 16:31:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf06ddc-737d-4036-8732-c91e5aa811f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:31:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Flow 'volume_create_manager' (cebfff3b-959f-49a5-919e-555c75aaec93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:31:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3a5ef031-e601-4e81-a53c-908c6af0beb7 tempest-VolumesGetTest-1293147614 None] Created volume successfully. Jul 28 16:31:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-e6a8c97d-5922-43ba-a551-06dd0927d7d3-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Lock "cinder-e6a8c97d-5922-43ba-a551-06dd0927d7d3-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-e6a8c97d-5922-43ba-a551-06dd0927d7d3" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-e6a8c97d-5922-43ba-a551-06dd0927d7d3" acquired by "delete_volume" :: waited 0.044s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3acf9a-da46-4e4a-b9ca-07dbbbcfba57]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:52 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 Jul 28 16:31:52 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:53 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3" returned: 0 in 0.867s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:53 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3 Jul 28 16:31:53 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:54 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e6a8c97d-5922-43ba-a551-06dd0927d7d3" returned: 0 in 1.134s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-e6a8c97d-5922-43ba-a551-06dd0927d7d3" released by "delete_volume" :: held 2.134s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Created reservations ['dd0621cf-d477-46f5-bab3-743b5a827e20', 'cd5b6963-1543-48c3-a0d9-f368fdbbb5db', '7650b41c-594a-4773-a54d-869bd688ebb6', '500ad497-d34d-488f-a09d-64d6c658b0e8'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:54 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:54 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:55 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.572s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:55 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Deleted volume successfully. Jul 28 16:31:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-13eda960-3fac-4fbe-bd70-379b36aa2f58 tempest-VolumesGetTest-1293147614 None] Lock "cinder-e6a8c97d-5922-43ba-a551-06dd0927d7d3-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Lock "cinder-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Acquiring lock "cinder-quobyte-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:31:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:31:56 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3024e23c-3765-4233-a511-cc20585e51c2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:31:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:56 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb Jul 28 16:31:56 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:57 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb" returned: 0 in 0.915s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:57 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb Jul 28 16:31:57 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:57 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb" returned: 0 in 0.718s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Lock "cinder-quobyte-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb" released by "delete_volume" :: held 1.754s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Created reservations ['4e51120c-59d7-4bb2-8050-a5ef071a037f', '58595d12-c364-4149-ae3d-47cef83b3b51', '36902d21-da52-4826-addb-f0a9bea09e40', 'c9b9c8a3-fe82-457d-a1bc-f3df925a6e20'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:31:58 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:31:58 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:31:58 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:31:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Deleted volume successfully. Jul 28 16:31:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-436dfec0-d182-4e9e-99d4-84d33bf196e4 tempest-VolumesGetTest-1293147614 None] Lock "cinder-d5192f8c-56d4-47bb-9ea3-a5d94523c7bb-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:08 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=20,cinder:SELECT=21,cinder:INSERT=11,cinder:DELETE=3 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:32:08 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:INSERT=10,cinder:SELECT=15,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Flow 'volume_create_manager' (ce68cc08-a81a-459f-9f6f-a62a1bf1a406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b302746e-5acb-4370-85d7-bbd07d99d739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b302746e-5acb-4370-85d7-bbd07d99d739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1716975512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba246d6b-b7df-4777-8abe-365bf6ebc333,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2975a52c86b94806bc5b892d6c5a30f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:10Z,use_quota=True,user_id='98eaf8fa0b4b4184a226a07d73189b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9486e5-1902-43f4-9c62-0b07ee8ad1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9486e5-1902-43f4-9c62-0b07ee8ad1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f1e9bc-aa5b-4260-a30e-1730c3cfeb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f1e9bc-aa5b-4260-a30e-1730c3cfeb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba246d6b-b7df-4777-8abe-365bf6ebc333', 'volume_name': 'volume-ba246d6b-b7df-4777-8abe-365bf6ebc333', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5eda182-1ea4-4a2b-9abc-1c4831a7f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5eda182-1ea4-4a2b-9abc-1c4831a7f076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77408e0b-d913-4603-8a3e-02864e6751b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:09 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Volume ba246d6b-b7df-4777-8abe-365bf6ebc333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba246d6b-b7df-4777-8abe-365bf6ebc333', 'volume_size': 1} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1716975512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba246d6b-b7df-4777-8abe-365bf6ebc333,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2975a52c86b94806bc5b892d6c5a30f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:10Z,use_quota=True,user_id='98eaf8fa0b4b4184a226a07d73189b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Creating volume ba246d6b-b7df-4777-8abe-365bf6ebc333 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:32:09 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:32:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:09 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 1073741824 Jul 28 16:32:09 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:10 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 1073741824" returned: 0 in 0.596s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:10 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 Jul 28 16:32:10 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:10 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333" returned: 0 in 0.358s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77408e0b-d913-4603-8a3e-02864e6751b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba246d6b-b7df-4777-8abe-365bf6ebc333', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b309735-7a89-439e-9a98-47d6c46ab71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Volume volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 (ba246d6b-b7df-4777-8abe-365bf6ebc333): created successfully Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b309735-7a89-439e-9a98-47d6c46ab71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Flow 'volume_create_manager' (ce68cc08-a81a-459f-9f6f-a62a1bf1a406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9e29cafc-4f66-4ba2-bf3e-7827f050875a tempest-VolumesListTestJSON-1833110890 None] Created volume successfully. Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6ee55961-c33a-423a-a02b-c29e549a7719 req-4f23c241-6e79-4959-97c9-ce0f9084e57e tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6ee55961-c33a-423a-a02b-c29e549a7719 req-4f23c241-6e79-4959-97c9-ce0f9084e57e tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6ee55961-c33a-423a-a02b-c29e549a7719 req-4f23c241-6e79-4959-97c9-ce0f9084e57e tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Flow 'volume_create_manager' (4111c290-7ce3-4a92-aa7c-68635bd70039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44372d09-20f3-4271-b96a-784410eaad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44372d09-20f3-4271-b96a-784410eaad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-834354148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a969db8-3a11-4b9c-9240-6aa1b9ca3e04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2975a52c86b94806bc5b892d6c5a30f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:13Z,use_quota=True,user_id='98eaf8fa0b4b4184a226a07d73189b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002b0017-734b-4580-a486-6140748744f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002b0017-734b-4580-a486-6140748744f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac5bb17-b504-46eb-9bfa-f26e6d607f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac5bb17-b504-46eb-9bfa-f26e6d607f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a969db8-3a11-4b9c-9240-6aa1b9ca3e04', 'volume_name': 'volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa32061-47c1-4856-bddf-07ad22dc6d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa32061-47c1-4856-bddf-07ad22dc6d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a7be78-0d4f-4426-9148-c82aa2d13dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:12 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Volume 2a969db8-3a11-4b9c-9240-6aa1b9ca3e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04', 'volume_size': 1} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-834354148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a969db8-3a11-4b9c-9240-6aa1b9ca3e04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2975a52c86b94806bc5b892d6c5a30f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:13Z,use_quota=True,user_id='98eaf8fa0b4b4184a226a07d73189b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Creating volume 2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:32:12 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:32:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-6ee55961-c33a-423a-a02b-c29e549a7719 req-4f23c241-6e79-4959-97c9-ce0f9084e57e tempest-TestInstancesWithCinderVolumes-331355615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-0a402fa1-000d-4cfc-998c-fa956aedafe9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '667fb1e7-7a09-40dd-8dc3-abda5d81bfbe', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:32:13 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 1073741824 Jul 28 16:32:13 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:13 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-6ee55961-c33a-423a-a02b-c29e549a7719 req-4f23c241-6e79-4959-97c9-ce0f9084e57e tempest-TestInstancesWithCinderVolumes-331355615 None] attachment_update completed successfully. Jul 28 16:32:13 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 1073741824" returned: 0 in 0.595s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:13 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 Jul 28 16:32:13 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:13 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:32:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a7be78-0d4f-4426-9148-c82aa2d13dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b92745e-0339-4019-a742-3c60d059a9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:14 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Volume volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 (2a969db8-3a11-4b9c-9240-6aa1b9ca3e04): created successfully Jul 28 16:32:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b92745e-0339-4019-a742-3c60d059a9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Flow 'volume_create_manager' (4111c290-7ce3-4a92-aa7c-68635bd70039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-013bcdee-575c-4993-b345-8cb8811306e3 tempest-VolumesListTestJSON-1833110890 None] Created volume successfully. Jul 28 16:32:15 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Flow 'volume_create_manager' (1378c85f-1ccf-4a3e-8f3c-9d6b0282739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c712173d-4347-4f8b-b5ae-38aff4f056be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c712173d-4347-4f8b-b5ae-38aff4f056be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1648310510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b65270-e18b-47bb-aa38-a7442cce51e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2975a52c86b94806bc5b892d6c5a30f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:16Z,use_quota=True,user_id='98eaf8fa0b4b4184a226a07d73189b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9801d53-2caa-4afe-8928-29fa1ef9b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9801d53-2caa-4afe-8928-29fa1ef9b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04920fcb-3577-4f75-a367-d45d81b5d9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04920fcb-3577-4f75-a367-d45d81b5d9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b65270-e18b-47bb-aa38-a7442cce51e6', 'volume_name': 'volume-18b65270-e18b-47bb-aa38-a7442cce51e6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bcdee5-026e-4988-845a-e2861bdc8582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bcdee5-026e-4988-845a-e2861bdc8582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8435f8-5b4e-4c40-ad13-c10dba868de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:16 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Volume 18b65270-e18b-47bb-aa38-a7442cce51e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b65270-e18b-47bb-aa38-a7442cce51e6', 'volume_size': 1} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1648310510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b65270-e18b-47bb-aa38-a7442cce51e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2975a52c86b94806bc5b892d6c5a30f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:16Z,use_quota=True,user_id='98eaf8fa0b4b4184a226a07d73189b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Creating volume 18b65270-e18b-47bb-aa38-a7442cce51e6 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:32:16 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:16 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 1073741824 Jul 28 16:32:16 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ea02894d-f97f-4081-b3a5-8765cdfca9c3 req-bcfd278a-ae08-4dcb-885b-1187ec99834b tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:16 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 1073741824" returned: 0 in 0.495s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:16 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 Jul 28 16:32:16 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:16 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ea02894d-f97f-4081-b3a5-8765cdfca9c3 req-bcfd278a-ae08-4dcb-885b-1187ec99834b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.725s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8435f8-5b4e-4c40-ad13-c10dba868de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b65270-e18b-47bb-aa38-a7442cce51e6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17260a38-e7a7-4bb0-9cdf-e3d3a2248461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ea02894d-f97f-4081-b3a5-8765cdfca9c3 req-bcfd278a-ae08-4dcb-885b-1187ec99834b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:17 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Volume volume-18b65270-e18b-47bb-aa38-a7442cce51e6 (18b65270-e18b-47bb-aa38-a7442cce51e6): created successfully Jul 28 16:32:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17260a38-e7a7-4bb0-9cdf-e3d3a2248461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Flow 'volume_create_manager' (1378c85f-1ccf-4a3e-8f3c-9d6b0282739a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ff46e7f2-4043-49c5-84c7-906902816709 tempest-VolumesListTestJSON-1833110890 None] Created volume successfully. Jul 28 16:32:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ea02894d-f97f-4081-b3a5-8765cdfca9c3 req-bcfd278a-ae08-4dcb-885b-1187ec99834b tempest-TestInstancesWithCinderVolumes-331355615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '973bf714-7f2d-43a0-af1d-7cc740b4d225', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:32:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-ea02894d-f97f-4081-b3a5-8765cdfca9c3 req-bcfd278a-ae08-4dcb-885b-1187ec99834b tempest-TestInstancesWithCinderVolumes-331355615 None] attachment_update completed successfully. Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "cinder-18b65270-e18b-47bb-aa38-a7442cce51e6-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-18b65270-e18b-47bb-aa38-a7442cce51e6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "cinder-quobyte-18b65270-e18b-47bb-aa38-a7442cce51e6" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-quobyte-18b65270-e18b-47bb-aa38-a7442cce51e6" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad53c338-c19d-4b4a-86f8-0251d367f8ff]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:21 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 Jul 28 16:32:21 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Flow 'volume_create_manager' (96cb7d6c-2947-4497-812a-797b5178f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a53978-80c5-4552-96bb-57b91284ca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a53978-80c5-4552-96bb-57b91284ca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1464440447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a50bed-4a45-49de-b942-73975c03fd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155c8fbac60448249c2cafffaab16f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:22Z,use_quota=True,user_id='7d3a8cf9e5354681b874fd56bb87165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b84447-5451-4ea7-8e80-1e817c77bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b84447-5451-4ea7-8e80-1e817c77bef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddecd79-a595-481a-9d2b-c7ae7f212c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddecd79-a595-481a-9d2b-c7ae7f212c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a50bed-4a45-49de-b942-73975c03fd39', 'volume_name': 'volume-30a50bed-4a45-49de-b942-73975c03fd39', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670c4074-a5ef-411d-ab13-f3e383168549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670c4074-a5ef-411d-ab13-f3e383168549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8153511c-c2b3-4efb-8964-539c4cff68f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:21 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Volume 30a50bed-4a45-49de-b942-73975c03fd39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a50bed-4a45-49de-b942-73975c03fd39', 'volume_size': 1} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1464440447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a50bed-4a45-49de-b942-73975c03fd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155c8fbac60448249c2cafffaab16f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:22Z,use_quota=True,user_id='7d3a8cf9e5354681b874fd56bb87165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Creating volume 30a50bed-4a45-49de-b942-73975c03fd39 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:32:21 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:21 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 1073741824 Jul 28 16:32:21 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:21 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6" returned: 0 in 0.496s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:21 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6 Jul 28 16:32:21 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:22 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-18b65270-e18b-47bb-aa38-a7442cce51e6" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-quobyte-18b65270-e18b-47bb-aa38-a7442cce51e6" released by "delete_volume" :: held 0.839s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Created reservations ['17015902-e1ae-461d-82dc-cab4beeec94a', '5b9a587e-ea4d-4681-80a6-0289e1d73f83', 'cd12134d-8614-4f08-b43c-1ecdae09b803', '431cc9b7-45d3-4480-9e4e-b6fba2ea7966'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:22 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:22 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:32:22 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 1073741824" returned: 0 in 0.606s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:22 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 Jul 28 16:32:22 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "cinder-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "cinder-quobyte-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-quobyte-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e35f0d-f827-4ce0-8202-f61116b8b816]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:22 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.469s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:32:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Deleted volume successfully. Jul 28 16:32:22 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39" returned: 0 in 0.368s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8153511c-c2b3-4efb-8964-539c4cff68f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a50bed-4a45-49de-b942-73975c03fd39', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086d38d0-5ca5-4926-8c88-4a60d54cf618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-55de9edf-2013-4187-b2b7-c18c49a4252d tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-18b65270-e18b-47bb-aa38-a7442cce51e6-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:22 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Volume volume-30a50bed-4a45-49de-b942-73975c03fd39 (30a50bed-4a45-49de-b942-73975c03fd39): created successfully Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086d38d0-5ca5-4926-8c88-4a60d54cf618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Flow 'volume_create_manager' (96cb7d6c-2947-4497-812a-797b5178f762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:22 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 Jul 28 16:32:22 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4ee83277-2986-448c-a7dd-5cb7e5c4fdee tempest-AttachVolumeTestJSON-200322447 None] Created volume successfully. Jul 28 16:32:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-b7d8f439-a78a-4323-9e73-d30a53c50c33 req-1010dd7f-395f-4c9e-a431-fc7fff77e94a tempest-TestInstancesWithCinderVolumes-331355615 None] Terminate volume connection completed successfully. Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-b7d8f439-a78a-4323-9e73-d30a53c50c33 req-1010dd7f-395f-4c9e-a431-fc7fff77e94a tempest-TestInstancesWithCinderVolumes-331355615 None] Deleting attachment 667fb1e7-7a09-40dd-8dc3-abda5d81bfbe. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:32:23 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04" returned: 0 in 0.468s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:23 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04 Jul 28 16:32:23 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:23 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04" returned: 0 in 0.303s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-quobyte-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04" released by "delete_volume" :: held 0.844s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Created reservations ['93794bba-7710-46ca-8660-cb4427da937c', '9605c067-b9f3-4df7-acaf-708d51991cca', 'e2cdaf20-e8f0-4e6b-b172-2166b65792fa', 'a89a1cba-43dd-4ae2-90f1-3b9dad955522'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "cinder-0a402fa1-000d-4cfc-998c-fa956aedafe9-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-0a402fa1-000d-4cfc-998c-fa956aedafe9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:23 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:32:23 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "cinder-quobyte-0a402fa1-000d-4cfc-998c-fa956aedafe9" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-quobyte-0a402fa1-000d-4cfc-998c-fa956aedafe9" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28baa92-f1ab-4dfd-89aa-71fcff2974eb]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "cinder-ba246d6b-b7df-4777-8abe-365bf6ebc333-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-ba246d6b-b7df-4777-8abe-365bf6ebc333-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:24 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 Jul 28 16:32:24 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "cinder-quobyte-ba246d6b-b7df-4777-8abe-365bf6ebc333" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-quobyte-ba246d6b-b7df-4777-8abe-365bf6ebc333" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:24 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.459s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:32:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Deleted volume successfully. Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[03520484-05fc-456b-8b4f-6e6b39e02bda]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ae7f75c-99fa-4090-8f53-51f5ab059891 tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-2a969db8-3a11-4b9c-9240-6aa1b9ca3e04-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:24 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 Jul 28 16:32:24 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:24 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9" returned: 0 in 0.598s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:24 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9 Jul 28 16:32:24 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:24 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333" returned: 0 in 0.542s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:24 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333 Jul 28 16:32:24 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:24 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0a402fa1-000d-4cfc-998c-fa956aedafe9" returned: 0 in 0.370s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-quobyte-0a402fa1-000d-4cfc-998c-fa956aedafe9" released by "delete_volume" :: held 1.054s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-aae63101-dc5a-478e-b1d5-1801dc300b3f req-1cfa6615-33d5-4050-8d08-63986926e90d tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-aae63101-dc5a-478e-b1d5-1801dc300b3f req-1cfa6615-33d5-4050-8d08-63986926e90d tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-aae63101-dc5a-478e-b1d5-1801dc300b3f req-1cfa6615-33d5-4050-8d08-63986926e90d tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:24 devstack cinder-volume[88286]: WARNING cinder.quota [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488820124-1928566076 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488820124-1928566076, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:32:24 devstack cinder-volume[88286]: WARNING cinder.quota [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488820124-1928566076 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488820124-1928566076, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-aae63101-dc5a-478e-b1d5-1801dc300b3f req-1cfa6615-33d5-4050-8d08-63986926e90d tempest-AttachVolumeTestJSON-200322447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-30a50bed-4a45-49de-b942-73975c03fd39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a11c2d5c-5b95-49e7-94a1-e40271730b5e', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:32:24 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Created reservations ['9a653cf3-3e6b-4ced-9245-ac5ec4bf7124', '0ce55323-f148-4e10-ae88-d368f927a12a', '2c46c90f-c65f-4a06-acf6-b90b82fd3cce', '054ad874-f69b-45b9-982d-541de8172353'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:32:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-aae63101-dc5a-478e-b1d5-1801dc300b3f req-1cfa6615-33d5-4050-8d08-63986926e90d tempest-AttachVolumeTestJSON-200322447 None] attachment_update completed successfully. Jul 28 16:32:25 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ba246d6b-b7df-4777-8abe-365bf6ebc333" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-quobyte-ba246d6b-b7df-4777-8abe-365bf6ebc333" released by "delete_volume" :: held 0.986s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:25 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:32:25 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Created reservations ['95f8cec3-2d7f-441f-bd56-256ed1819b1f', '2def5bc3-61b0-4d05-b6c1-202a682fd222', '33057a39-f021-492c-9992-76090f37b166', '70520b81-7cd6-48f6-a383-510b8c670fe2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:25 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:32:25 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:25 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.388s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:32:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Deleted volume successfully. Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a9c6cdfd-5fa5-4a36-a588-5dd01a0d971c tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-0a402fa1-000d-4cfc-998c-fa956aedafe9-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:25 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.373s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:32:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Deleted volume successfully. Jul 28 16:32:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9b8cfd58-fa1e-48c5-87c7-1e27c399918f tempest-VolumesListTestJSON-1833110890 None] Lock "cinder-ba246d6b-b7df-4777-8abe-365bf6ebc333-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-cddf15a1-e67e-407d-b758-511487f9141f req-947f6199-16b5-4a9f-b1cb-7fcf34dd920a tempest-TestInstancesWithCinderVolumes-331355615 None] Terminate volume connection completed successfully. Jul 28 16:32:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-cddf15a1-e67e-407d-b758-511487f9141f req-947f6199-16b5-4a9f-b1cb-7fcf34dd920a tempest-TestInstancesWithCinderVolumes-331355615 None] Deleting attachment 973bf714-7f2d-43a0-af1d-7cc740b4d225. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:32:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "cinder-4e645096-5964-4d13-a38e-b2c0cb0d2e9d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-4e645096-5964-4d13-a38e-b2c0cb0d2e9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "cinder-quobyte-4e645096-5964-4d13-a38e-b2c0cb0d2e9d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-quobyte-4e645096-5964-4d13-a38e-b2c0cb0d2e9d" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449bb79-6708-4b85-84e5-efcbbc466e77]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:29 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d Jul 28 16:32:29 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:30 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d" returned: 0 in 0.586s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:30 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d Jul 28 16:32:30 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:30 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e645096-5964-4d13-a38e-b2c0cb0d2e9d" returned: 0 in 0.334s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-quobyte-4e645096-5964-4d13-a38e-b2c0cb0d2e9d" released by "delete_volume" :: held 1.006s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:30 devstack cinder-volume[88286]: WARNING cinder.quota [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571215452-1789661517 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571215452-1789661517, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:32:30 devstack cinder-volume[88286]: WARNING cinder.quota [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571215452-1789661517 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571215452-1789661517, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Created reservations ['e569040e-b733-44bb-869d-038c1b23ea09', '45267c04-d435-4648-8229-2d2e4de9badd', '158e0a1d-833d-45a2-ad90-ff8a45f6b28d', '0fa4d732-3e5b-4d21-ac7f-710050502cdd'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:30 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:32:30 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:30 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.337s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:30 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:32:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Deleted volume successfully. Jul 28 16:32:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-06772a77-ca66-40e5-a3f4-764553316e8b tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-4e645096-5964-4d13-a38e-b2c0cb0d2e9d-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6643a8c9-2970-4638-a65c-a74e3bad23ac req-3c67fefd-73fc-4537-a3d1-1ba70e6fc37f tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6643a8c9-2970-4638-a65c-a74e3bad23ac req-3c67fefd-73fc-4537-a3d1-1ba70e6fc37f tempest-TestStampPattern-1961021372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-6643a8c9-2970-4638-a65c-a74e3bad23ac req-3c67fefd-73fc-4537-a3d1-1ba70e6fc37f tempest-TestStampPattern-1961021372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-6643a8c9-2970-4638-a65c-a74e3bad23ac req-3c67fefd-73fc-4537-a3d1-1ba70e6fc37f tempest-TestStampPattern-1961021372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '195e5b05-d91f-48d9-923c-d022deb1a896', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:32:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-6643a8c9-2970-4638-a65c-a74e3bad23ac req-3c67fefd-73fc-4537-a3d1-1ba70e6fc37f tempest-TestStampPattern-1961021372 None] attachment_update completed successfully. Jul 28 16:32:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-0d684b68-ac39-4903-89f9-b11825c576e4 req-cb2eeb63-4bbc-45a4-b8f8-b564978e284a tempest-TestInstancesWithCinderVolumes-331355615 None] Terminate volume connection completed successfully. Jul 28 16:32:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-0d684b68-ac39-4903-89f9-b11825c576e4 req-cb2eeb63-4bbc-45a4-b8f8-b564978e284a tempest-TestInstancesWithCinderVolumes-331355615 None] Deleting attachment 1698f17c-96c8-4967-988d-8d252e18bd59. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:32:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "cinder-db56f670-fed0-4fbd-95ad-258dac553436-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-db56f670-fed0-4fbd-95ad-258dac553436-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "cinder-quobyte-db56f670-fed0-4fbd-95ad-258dac553436" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-quobyte-db56f670-fed0-4fbd-95ad-258dac553436" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad40266-8a85-4147-85db-084daedb5170]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:40 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 Jul 28 16:32:40 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:41 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:32:41 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:41 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436" returned: 0 in 0.699s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:41 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436 Jul 28 16:32:41 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:41 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.491s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:32:41 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-db56f670-fed0-4fbd-95ad-258dac553436" returned: 0 in 0.572s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-quobyte-db56f670-fed0-4fbd-95ad-258dac553436" released by "delete_volume" :: held 1.362s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:41 devstack cinder-volume[88286]: WARNING cinder.quota [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1888781385-60115257 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1888781385-60115257, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:32:41 devstack cinder-volume[88286]: WARNING cinder.quota [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1888781385-60115257 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1888781385-60115257, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Created reservations ['91f07d9a-0a6e-4e56-9359-4979753c08d8', '039f70f3-d6a3-46ba-98b9-204b86c37ebb', '17ed1cbd-edb8-4219-8327-f883130afac7', 'aacb817a-895e-4c6d-bde7-f0094732eb64'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:42 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:32:42 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:42 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.684s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:32:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Deleted volume successfully. Jul 28 16:32:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-94b3fab1-f2ce-4559-b203-9cd6b93d8073 tempest-TestInstancesWithCinderVolumes-331355615 None] Lock "cinder-db56f670-fed0-4fbd-95ad-258dac553436-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-07f5865b-bb16-48ff-a42e-8a22608dcbe6 req-c53f33d5-58a9-4649-8322-f86ef3bb884b tempest-TestStampPattern-1961021372 None] Terminate volume connection completed successfully. Jul 28 16:32:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-07f5865b-bb16-48ff-a42e-8a22608dcbe6 req-c53f33d5-58a9-4649-8322-f86ef3bb884b tempest-TestStampPattern-1961021372 None] Deleting attachment 195e5b05-d91f-48d9-923c-d022deb1a896. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:32:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Creating offline snapshot 9d397bbe-4623-4835-a116-c38747497365 of volume f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:32:44 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecda3ed-c4dc-4ae5-8563-72c7ebe7bd56]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:45 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 Jul 28 16:32:45 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:45 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" returned: 0 in 0.617s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:45 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 1G Jul 28 16:32:45 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:46 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 1G" returned: 0 in 0.858s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:46 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 Jul 28 16:32:46 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:47 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365" returned: 0 in 0.604s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:47 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 is being set with open permissions: ugo+rw Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:47 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 Jul 28 16:32:47 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (af221767-7516-4bf1-975e-cad9bc9f638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6813ddb4-c233-4b8b-8b5f-d876e3402533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6813ddb4-c233-4b8b-8b5f-d876e3402533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1464671014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab21696c-ba1a-4593-bc81-41ca6019698f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:47Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cab8d2-afba-48a3-87b7-6bd9c8eb83cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cab8d2-afba-48a3-87b7-6bd9c8eb83cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821eca46-b92b-4b60-a83c-4e5d3e4d3706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821eca46-b92b-4b60-a83c-4e5d3e4d3706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab21696c-ba1a-4593-bc81-41ca6019698f', 'volume_name': 'volume-ab21696c-ba1a-4593-bc81-41ca6019698f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c51bbb7-6221-40fe-822d-bf22c72c4765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c51bbb7-6221-40fe-822d-bf22c72c4765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187b3ce9-6052-42e7-9a4c-8f0f746da0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Volume ab21696c-ba1a-4593-bc81-41ca6019698f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab21696c-ba1a-4593-bc81-41ca6019698f', 'volume_size': 1} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:47 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365" returned: 0 in 0.450s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:47 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.info Jul 28 16:32:47 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:47 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.info" returned: 0 in 0.347s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:47 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.info is being set with open permissions: ugo+rw Jul 28 16:32:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:47 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.info Jul 28 16:32:47 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:48 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.info" returned: 0 in 0.341s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.357s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1464671014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab21696c-ba1a-4593-bc81-41ca6019698f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:47Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Creating volume ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:32:48 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:48 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f 1073741824 Jul 28 16:32:48 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:48 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5fb62b84-6a3f-4702-a9e4-b0874b8786cb tempest-TestStampPattern-1961021372 None] Create snapshot completed successfully Jul 28 16:32:48 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f 1073741824" returned: 0 in 0.593s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:48 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f Jul 28 16:32:48 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:49 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f" returned: 0 in 0.323s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:32:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187b3ce9-6052-42e7-9a4c-8f0f746da0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab21696c-ba1a-4593-bc81-41ca6019698f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae2975f-5b82-4f01-aa66-0b7b2f8b81cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:49 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Volume volume-ab21696c-ba1a-4593-bc81-41ca6019698f (ab21696c-ba1a-4593-bc81-41ca6019698f): created successfully Jul 28 16:32:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae2975f-5b82-4f01-aa66-0b7b2f8b81cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (af221767-7516-4bf1-975e-cad9bc9f638a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3021111d-521a-4312-a39c-e0e5a315232c tempest-VolumesSnapshotTestJSON-1737189081 None] Created volume successfully. Jul 28 16:32:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Creating offline snapshot 8b52b730-d663-4109-a45b-7759058f48b2 of volume ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:32:51 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae70a253-bf53-4efb-9708-c78844d8c937]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:51 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f Jul 28 16:32:51 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:51 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f" returned: 0 in 0.572s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:51 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 1G Jul 28 16:32:51 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:52 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 1G" returned: 0 in 0.613s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab21696c-ba1a-4593-bc81-41ca6019698f -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:52 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab21696c-ba1a-4593-bc81-41ca6019698f -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 Jul 28 16:32:52 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:52 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab21696c-ba1a-4593-bc81-41ca6019698f -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2" returned: 0 in 0.408s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:52 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 is being set with open permissions: ugo+rw Jul 28 16:32:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:52 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 Jul 28 16:32:52 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:53 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:53 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.info Jul 28 16:32:53 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:53 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.info" returned: 0 in 0.312s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:53 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.info is being set with open permissions: ugo+rw Jul 28 16:32:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:53 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.info Jul 28 16:32:53 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:53 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.info" returned: 0 in 0.274s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cb8255bf-07d6-463d-96c4-eaa3d14a24f0 tempest-VolumesSnapshotTestJSON-1737189081 None] Create snapshot completed successfully Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-8b52b730-d663-4109-a45b-7759058f48b2-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-8b52b730-d663-4109-a45b-7759058f48b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-ab21696c-ba1a-4593-bc81-41ca6019698f" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-ab21696c-ba1a-4593-bc81-41ca6019698f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-8b52b730-d663-4109-a45b-7759058f48b2" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-8b52b730-d663-4109-a45b-7759058f48b2" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Deleting offline snapshot 8b52b730-d663-4109-a45b-7759058f48b2 of volume ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] snapshot_file for this snap is: volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bafc3dc-38fb-4f7e-aa2f-a211fcf0a412]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:54 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 Jul 28 16:32:54 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:55 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab21696c-ba1a-4593-bc81-41ca6019698f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:32:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a2751-3348-4bd9-b073-4a2175b3c19a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:55 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f Jul 28 16:32:55 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:55 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:55 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 Jul 28 16:32:55 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:56 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:56 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2 Jul 28 16:32:56 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:56 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f.8b52b730-d663-4109-a45b-7759058f48b2" returned: 0 in 0.340s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-8b52b730-d663-4109-a45b-7759058f48b2" released by "_delete_snapshot" :: held 1.964s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-ab21696c-ba1a-4593-bc81-41ca6019698f" released by "delete_snapshot" :: held 2.002s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:56 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['d8f77009-f6b9-48fc-ac7d-3f09c0697423', 'f7a51331-9d56-4c93-8f61-3f4e3e8003da', '19fe041b-ff7a-424d-827d-aa268e4b9909', '7b291a31-e2e8-457e-85be-0faa35186033'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:32:56 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Delete snapshot completed successfully. Jul 28 16:32:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a99e6960-2e11-4ead-9083-01568f539f3a tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-8b52b730-d663-4109-a45b-7759058f48b2-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Flow 'volume_create_manager' (f9a41e1a-3657-4c9f-ba9c-8ad1c1d7fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2243e7-45f7-40e5-b764-579550473b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2243e7-45f7-40e5-b764-579550473b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-479098816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e74201-1d11-4283-b31e-37306228757d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9eeba736cb94ade900299245867df92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d397bbe-4623-4835-a116-c38747497365,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:58Z,use_quota=True,user_id='9b32e6713c8c4575b97e22ea23b3144e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0214907e-7204-4d34-b86d-41451b5f0c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0214907e-7204-4d34-b86d-41451b5f0c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e645c1d-74df-4a52-915f-f3899818a3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e645c1d-74df-4a52-915f-f3899818a3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2e74201-1d11-4283-b31e-37306228757d', 'volume_name': 'volume-c2e74201-1d11-4283-b31e-37306228757d', 'volume_size': 1, 'snapshot_id': '9d397bbe-4623-4835-a116-c38747497365'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b80367-cfa7-41c8-bf1e-42d34a07b030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b80367-cfa7-41c8-bf1e-42d34a07b030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffa3c30-58b9-43b1-80c8-e2ac6d9ae748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Volume c2e74201-1d11-4283-b31e-37306228757d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2e74201-1d11-4283-b31e-37306228757d', 'volume_size': 1, 'snapshot_id': '9d397bbe-4623-4835-a116-c38747497365'} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-quobyte-9d397bbe-4623-4835-a116-c38747497365-c2e74201-1d11-4283-b31e-37306228757d" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-9d397bbe-4623-4835-a116-c38747497365-c2e74201-1d11-4283-b31e-37306228757d" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Creating volume c2e74201-1d11-4283-b31e-37306228757d from snapshot 9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-quobyte-c2e74201-1d11-4283-b31e-37306228757d" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-c2e74201-1d11-4283-b31e-37306228757d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] snapshot: 9d397bbe-4623-4835-a116-c38747497365, volume: c2e74201-1d11-4283-b31e-37306228757d, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bef16d-938f-4115-b2eb-4df652dcce80]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (e731289b-5668-4e54-9208-487be4ce563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c598e539-74a3-4ebb-b69c-e45a3ed73dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c598e539-74a3-4ebb-b69c-e45a3ed73dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1004366877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:59Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 Jul 28 16:32:58 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422213b1-1040-4e3e-8d93-b58c2e30853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422213b1-1040-4e3e-8d93-b58c2e30853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe2749c-4abd-4538-b732-c4249060738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe2749c-4abd-4538-b732-c4249060738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e', 'volume_name': 'volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cca9b1-466b-42ce-839d-be08f71d94b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cca9b1-466b-42ce-839d-be08f71d94b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c727b9ff-8019-46d4-b8b7-053fa95bcc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:32:58 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Volume 9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e', 'volume_size': 1} Jul 28 16:32:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:32:59 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365" returned: 0 in 0.497s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[65094252-8ba6-4bc5-ba79-bbd1af9290b0]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:59 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 Jul 28 16:32:59 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:32:59 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" returned: 0 in 0.471s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:32:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:32:59 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d Jul 28 16:32:59 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-5f1052b1-6081-4f24-a375-b93f97982f82 req-a864567c-3791-45a9-beff-a56be0378a71 tempest-AttachVolumeTestJSON-200322447 None] Terminate volume connection completed successfully. Jul 28 16:33:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-5f1052b1-6081-4f24-a375-b93f97982f82 req-a864567c-3791-45a9-beff-a56be0378a71 tempest-AttachVolumeTestJSON-200322447 None] Deleting attachment a11c2d5c-5b95-49e7-94a1-e40271730b5e. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:33:07 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d" returned: 0 in 7.360s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a00b12-c252-4501-a5c9-09f21f699c54]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:07 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 Jul 28 16:33:07 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:07 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" returned: 0 in 0.684s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:07 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:33:07 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Converted 1024.00 MB image at 139.07 MB/s Jul 28 16:33:07 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d is being set with open permissions: ugo+rw Jul 28 16:33:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:07 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d Jul 28 16:33:07 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:08 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d" returned: 0 in 0.444s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-c2e74201-1d11-4283-b31e-37306228757d" released by "_copy_volume_from_snapshot" :: held 9.650s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-9d397bbe-4623-4835-a116-c38747497365-c2e74201-1d11-4283-b31e-37306228757d" released by "_create_volume_from_snapshot" :: held 9.720s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.773s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.376s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1004366877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:32:59Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Creating volume 9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:33:08 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=86,cinder:SELECT=90,cinder:INSERT=19,cinder:DELETE=7 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:33:08 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e 1073741824 Jul 28 16:33:08 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffa3c30-58b9-43b1-80c8-e2ac6d9ae748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e74201-1d11-4283-b31e-37306228757d', 'volume_size': 1, 'snapshot_id': '9d397bbe-4623-4835-a116-c38747497365'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66040a4-9b31-4421-994b-762234d1185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Volume volume-c2e74201-1d11-4283-b31e-37306228757d (c2e74201-1d11-4283-b31e-37306228757d): created successfully Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66040a4-9b31-4421-994b-762234d1185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Flow 'volume_create_manager' (f9a41e1a-3657-4c9f-ba9c-8ad1c1d7fd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-032f7f63-6cb9-4c03-b27b-62942ec6b47f tempest-TestStampPattern-1961021372 None] Created volume successfully. Jul 28 16:33:09 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e 1073741824" returned: 0 in 0.798s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=98,cinder:UPDATE=75,cinder:DELETE=6,cinder:INSERT=16 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:09 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e Jul 28 16:33:09 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:09 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" returned: 0 in 0.418s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c727b9ff-8019-46d4-b8b7-053fa95bcc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a424789-8e91-45d2-8af9-be956bd441ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:09 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Volume volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e (9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e): created successfully Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a424789-8e91-45d2-8af9-be956bd441ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (e731289b-5668-4e54-9208-487be4ce563b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-019f3949-30ad-4142-abd9-59674b0059dc tempest-VolumesSnapshotTestJSON-1737189081 None] Created volume successfully. Jul 28 16:33:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Creating offline snapshot 3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 of volume 9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:33:11 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f056f5-a722-4b0e-8dee-90925bbaafb3]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:11 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e Jul 28 16:33:11 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:11 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" returned: 0 in 0.487s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:11 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 1G Jul 28 16:33:11 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:12 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 1G" returned: 0 in 0.714s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:12 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 Jul 28 16:33:12 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:12 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" returned: 0 in 0.648s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:12 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 is being set with open permissions: ugo+rw Jul 28 16:33:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:12 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 Jul 28 16:33:12 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:13 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" returned: 0 in 0.853s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:13 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.info Jul 28 16:33:13 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:14 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.info" returned: 0 in 0.649s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:14 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.info is being set with open permissions: ugo+rw Jul 28 16:33:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:14 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.info Jul 28 16:33:14 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:15 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.info" returned: 0 in 0.627s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-35fc1184-6d18-4227-bb37-64d5f75a36e5 tempest-VolumesSnapshotTestJSON-1737189081 None] Create snapshot completed successfully Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (b11ff5ac-1eb0-4beb-864b-53699d722ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dda91b-e4ff-4f34-acfd-42da9b540a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dda91b-e4ff-4f34-acfd-42da9b540a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1854130590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954acfb9-77fa-49df-b415-e3fb0448012d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:33:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:33:18Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9342993-5b21-4e40-8810-6ffc9a25ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9342993-5b21-4e40-8810-6ffc9a25ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b4140f-fce0-4b74-beeb-a94c94f836d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b4140f-fce0-4b74-beeb-a94c94f836d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '954acfb9-77fa-49df-b415-e3fb0448012d', 'volume_name': 'volume-954acfb9-77fa-49df-b415-e3fb0448012d', 'volume_size': 2, 'snapshot_id': '3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b21fbc-c3c9-4edb-8406-54b92e9659a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b21fbc-c3c9-4edb-8406-54b92e9659a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b33e6a-11d7-486f-a161-ca56f154860b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:17 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Volume 954acfb9-77fa-49df-b415-e3fb0448012d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-954acfb9-77fa-49df-b415-e3fb0448012d', 'volume_size': 2, 'snapshot_id': '3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773'} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773-954acfb9-77fa-49df-b415-e3fb0448012d" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773-954acfb9-77fa-49df-b415-e3fb0448012d" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Creating volume 954acfb9-77fa-49df-b415-e3fb0448012d from snapshot 3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-954acfb9-77fa-49df-b415-e3fb0448012d" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-954acfb9-77fa-49df-b415-e3fb0448012d" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] snapshot: 3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773, volume: 954acfb9-77fa-49df-b415-e3fb0448012d, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:33:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:18 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b91f6-3e01-4998-a4ff-23297e91aadc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:18 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 Jul 28 16:33:18 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:19 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" returned: 0 in 1.164s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:33:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:33:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:33:19 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8d5012-66b3-4d53-95d9-6b049212a048]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:19 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e Jul 28 16:33:19 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:20 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" returned: 0 in 0.772s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:20 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:33:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:20 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d Jul 28 16:33:20 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:27 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=7,cinder:DELETE=3,cinder:SELECT=7,cinder:INSERT=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:33:27 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:33:29 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d" returned: 0 in 9.434s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7a1637-a4c7-48d0-a0b9-f830bf13c6b4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:29 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e Jul 28 16:33:29 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:30 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" returned: 0 in 0.715s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:33:30 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Converted 1024.00 MB image at 108.53 MB/s Jul 28 16:33:30 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d is being set with open permissions: ugo+rw Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:30 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d Jul 28 16:33:30 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:30 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-954acfb9-77fa-49df-b415-e3fb0448012d" released by "_copy_volume_from_snapshot" :: held 12.720s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773-954acfb9-77fa-49df-b415-e3fb0448012d" released by "_create_volume_from_snapshot" :: held 12.776s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.801s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b33e6a-11d7-486f-a161-ca56f154860b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954acfb9-77fa-49df-b415-e3fb0448012d', 'volume_size': 2, 'snapshot_id': '3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da3a43e-ae20-403f-a05f-ac2665bab50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:30 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Volume volume-954acfb9-77fa-49df-b415-e3fb0448012d (954acfb9-77fa-49df-b415-e3fb0448012d): created successfully Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da3a43e-ae20-403f-a05f-ac2665bab50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (b11ff5ac-1eb0-4beb-864b-53699d722ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3cac8450-b089-4d3a-9da5-45447060eaf6 tempest-VolumesSnapshotTestJSON-1737189081 None] Created volume successfully. Jul 28 16:33:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-954acfb9-77fa-49df-b415-e3fb0448012d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-954acfb9-77fa-49df-b415-e3fb0448012d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-954acfb9-77fa-49df-b415-e3fb0448012d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-954acfb9-77fa-49df-b415-e3fb0448012d" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:31 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[736748db-b3b6-44b0-a84b-3acef24d02ae]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:31 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d Jul 28 16:33:31 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:32 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d" returned: 0 in 0.502s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:32 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d Jul 28 16:33:32 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:32 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-954acfb9-77fa-49df-b415-e3fb0448012d" returned: 0 in 0.330s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-954acfb9-77fa-49df-b415-e3fb0448012d" released by "delete_volume" :: held 0.897s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['23e75103-91f7-475f-be4a-ecda14152e28', '15f0b5a1-befb-43a7-9258-6801129274f1', '1e67f50e-374e-456a-a541-d0daf4835b58', '862a9528-ea5e-4d20-aa66-2592f616ffcb'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:32 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:33:32 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:33 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:33:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Deleted volume successfully. Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b4a13433-ba63-4a32-b10f-64186f5620f5 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-954acfb9-77fa-49df-b415-e3fb0448012d-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Deleting offline snapshot 3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 of volume 9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] snapshot_file for this snap is: volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb40c2-9039-4a66-8866-acbdf56b91be]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:34 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 Jul 28 16:33:34 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:34 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" returned: 0 in 0.513s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:33:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca792af8-c658-4ce7-b560-721a3e28ab8a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:34 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e Jul 28 16:33:34 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:34 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:34 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 Jul 28 16:33:34 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:35 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" returned: 0 in 0.458s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:35 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773 Jul 28 16:33:35 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:35 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e.3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773" released by "_delete_snapshot" :: held 1.848s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" released by "delete_snapshot" :: held 1.879s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:35 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['982bac32-0c1e-461c-b322-ee75b6a7e3dd', 'a4c2c9e7-52aa-471e-84c5-419f667a697b', 'f996df09-036d-45ca-a3e2-501f41831911', 'b2bc64c3-4116-4cb7-a926-3b7268cf9793'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:33:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Delete snapshot completed successfully. Jul 28 16:33:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-12db4445-cfac-49a0-a4d2-e096afe87309 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-3edc4fbc-f05b-4db2-b3e5-b9f4bf0fd773-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5759654-c6b8-4d25-949f-2ea7d5d3cffc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:36 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e Jul 28 16:33:36 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:36 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" returned: 0 in 0.445s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:36 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e Jul 28 16:33:36 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:37 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" returned: 0 in 0.299s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e" released by "delete_volume" :: held 0.819s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['bf9f9b85-9b4f-4a6e-8f97-6f09b6f94d79', '6e398b6b-5e58-4d4f-96e3-0a71e39aa6b7', '5cd94852-ab2c-4c7e-aabf-8faee974cb31', '757b57fb-90d3-414f-8927-743568025b4f'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:37 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:33:37 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:37 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.366s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:33:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Deleted volume successfully. Jul 28 16:33:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1036761-4a3d-4678-b514-8976f19b0154 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-9d50e1d8-ea19-44b7-ac0f-2ad7f7e6fe8e-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (2176fe45-43fd-4942-ba9a-2c1ec9edd730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b3dbf8-7566-4ca1-ba49-32e3e9f4445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b3dbf8-7566-4ca1-ba49-32e3e9f4445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493782474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18e836c-150f-47de-ab46-fe51e59590c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:33:38Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d575bd-a853-46e7-90c4-8a2fed0a6ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d575bd-a853-46e7-90c4-8a2fed0a6ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c548a-e1fa-4c0e-b201-b262082acef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c548a-e1fa-4c0e-b201-b262082acef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a18e836c-150f-47de-ab46-fe51e59590c2', 'volume_name': 'volume-a18e836c-150f-47de-ab46-fe51e59590c2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0a97a8-9a39-457b-8a75-87d677b65ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0a97a8-9a39-457b-8a75-87d677b65ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab65bd9a-2664-4397-9789-c59c47c71da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:38 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Volume a18e836c-150f-47de-ab46-fe51e59590c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a18e836c-150f-47de-ab46-fe51e59590c2', 'volume_size': 1} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493782474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18e836c-150f-47de-ab46-fe51e59590c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:33:38Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Creating volume a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:33:38 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:38 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 1073741824 Jul 28 16:33:38 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:38 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 1073741824" returned: 0 in 0.595s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:38 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 Jul 28 16:33:38 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:39 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2" returned: 0 in 0.533s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:33:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab65bd9a-2664-4397-9789-c59c47c71da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18e836c-150f-47de-ab46-fe51e59590c2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aefd38-9422-43e5-ba14-76ab350b0e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:39 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Volume volume-a18e836c-150f-47de-ab46-fe51e59590c2 (a18e836c-150f-47de-ab46-fe51e59590c2): created successfully Jul 28 16:33:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aefd38-9422-43e5-ba14-76ab350b0e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (2176fe45-43fd-4942-ba9a-2c1ec9edd730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:39 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-056edea4-baba-4f54-97af-f61aa2c48a7d tempest-VolumesSnapshotTestJSON-1737189081 None] Created volume successfully. Jul 28 16:33:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Creating offline snapshot 0387ddea-dcc4-43f3-a0f2-a308dc264f9d of volume a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:33:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f899d978-1af9-40f2-8409-9bb8de25f696]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:40 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 Jul 28 16:33:40 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:33:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:33:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:33:41 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2" returned: 0 in 0.678s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:41 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d 1G Jul 28 16:33:41 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:42 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d 1G" returned: 0 in 0.678s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18e836c-150f-47de-ab46-fe51e59590c2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:42 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18e836c-150f-47de-ab46-fe51e59590c2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d Jul 28 16:33:42 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:42 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18e836c-150f-47de-ab46-fe51e59590c2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d" returned: 0 in 0.528s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:42 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d is being set with open permissions: ugo+rw Jul 28 16:33:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:42 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d Jul 28 16:33:42 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:43 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d" returned: 0 in 0.413s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:43 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.info Jul 28 16:33:43 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:43 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.info" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:43 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.info is being set with open permissions: ugo+rw Jul 28 16:33:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:43 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.info Jul 28 16:33:43 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:43 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.info" returned: 0 in 0.318s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.162s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5416f10a-7b56-4501-8dfc-18bc0392a513 tempest-VolumesSnapshotTestJSON-1737189081 None] Create snapshot completed successfully Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (10168f46-789e-4f99-a366-ef3b993acc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe8961d-c47b-44b3-ac62-8e16c2346d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe8961d-c47b-44b3-ac62-8e16c2346d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-991750111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fcb3a5-1c81-4b03-a13a-257fef56783b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3ab25d7a304343b59a1e14c11c4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0387ddea-dcc4-43f3-a0f2-a308dc264f9d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:33:46Z,use_quota=True,user_id='0ba61ed4c11340e8b40fe0b6d42af76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c23dce3-2d31-4a2f-8fb3-c8213f8b801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c23dce3-2d31-4a2f-8fb3-c8213f8b801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ebaadf-bb5e-4874-bcd4-9a3957caede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ebaadf-bb5e-4874-bcd4-9a3957caede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8fcb3a5-1c81-4b03-a13a-257fef56783b', 'volume_name': 'volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b', 'volume_size': 1, 'snapshot_id': '0387ddea-dcc4-43f3-a0f2-a308dc264f9d'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1371bcf8-c38b-4fb5-ac37-f5d188e76d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1371bcf8-c38b-4fb5-ac37-f5d188e76d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765dfd9f-24c0-4a3d-83af-6fc73cdb65f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Volume e8fcb3a5-1c81-4b03-a13a-257fef56783b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b', 'volume_size': 1, 'snapshot_id': '0387ddea-dcc4-43f3-a0f2-a308dc264f9d'} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-0387ddea-dcc4-43f3-a0f2-a308dc264f9d-e8fcb3a5-1c81-4b03-a13a-257fef56783b" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-0387ddea-dcc4-43f3-a0f2-a308dc264f9d-e8fcb3a5-1c81-4b03-a13a-257fef56783b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Creating volume e8fcb3a5-1c81-4b03-a13a-257fef56783b from snapshot 0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-e8fcb3a5-1c81-4b03-a13a-257fef56783b" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-e8fcb3a5-1c81-4b03-a13a-257fef56783b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] snapshot: 0387ddea-dcc4-43f3-a0f2-a308dc264f9d, volume: e8fcb3a5-1c81-4b03-a13a-257fef56783b, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9442f04-e9f9-49c9-8b59-bbc184fe1a2a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:45 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d Jul 28 16:33:45 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:46 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d" returned: 0 in 0.497s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a18e836c-150f-47de-ab46-fe51e59590c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82e73ea-abae-4cb8-8171-81080c4e3ed0]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:46 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 Jul 28 16:33:46 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:46 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2" returned: 0 in 0.526s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:33:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:46 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b Jul 28 16:33:46 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-a3fba08c-8629-4d72-b15f-82af2052a75e req-6cdbc51f-39de-45ff-a6bf-80cbd2e01126 tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Flow 'volume_create_manager' (06c73d2a-fda4-4885-b735-3c6d33d6a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8f9b93-c02e-4d5d-b02f-a8750b1c0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8f9b93-c02e-4d5d-b02f-a8750b1c0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1611775294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053d3f14-dd9a-4149-b71c-7d9c22832891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45974f463ffb45a98b2df4361f3c6d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:33:52Z,use_quota=True,user_id='8e10feba57054ae6ae85506db6b7cbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdb457c-162c-450d-913d-267c91d5d604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdb457c-162c-450d-913d-267c91d5d604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3d8559-deb4-438f-9e14-fd683ed406b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:52 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:33:53 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b" returned: 0 in 6.410s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5640cec-d11b-4bd5-b115-8c2f6dc01fe4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:53 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 Jul 28 16:33:53 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3d8559-deb4-438f-9e14-fd683ed406b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '053d3f14-dd9a-4149-b71c-7d9c22832891', 'volume_name': 'volume-053d3f14-dd9a-4149-b71c-7d9c22832891', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883479f9-7887-4136-a5d4-6eba6dca0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883479f9-7887-4136-a5d4-6eba6dca0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d568d9-a081-418d-baf6-d75a22c7f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Volume 053d3f14-dd9a-4149-b71c-7d9c22832891: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-053d3f14-dd9a-4149-b71c-7d9c22832891', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 16:33:53 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Trying to clone 053d3f14-dd9a-4149-b71c-7d9c22832891 from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:33:54 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2" returned: 0 in 0.773s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:33:54 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Converted 1024.00 MB image at 159.68 MB/s Jul 28 16:33:54 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b is being set with open permissions: ugo+rw Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:54 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b Jul 28 16:33:54 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:33:54 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Image download 20.69 MB at 20.69 MB/s Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5242af73-ea2d-46a8-a0d3-8d6382a4f5e1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:54 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD Jul 28 16:33:54 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:54 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b" returned: 0 in 0.381s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-e8fcb3a5-1c81-4b03-a13a-257fef56783b" released by "_copy_volume_from_snapshot" :: held 8.728s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-0387ddea-dcc4-43f3-a0f2-a308dc264f9d-e8fcb3a5-1c81-4b03-a13a-257fef56783b" released by "_create_volume_from_snapshot" :: held 8.770s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.790s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-a3fba08c-8629-4d72-b15f-82af2052a75e req-6cdbc51f-39de-45ff-a6bf-80cbd2e01126 tempest-TestStampPattern-1961021372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.239s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765dfd9f-24c0-4a3d-83af-6fc73cdb65f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b', 'volume_size': 1, 'snapshot_id': '0387ddea-dcc4-43f3-a0f2-a308dc264f9d'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b130db57-47ee-47f4-9f2f-0fbde518b2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8cb0cc-2b95-4c9f-a2e6-6913fa8c7824]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-a3fba08c-8629-4d72-b15f-82af2052a75e req-6cdbc51f-39de-45ff-a6bf-80cbd2e01126 tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:54 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Volume volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b (e8fcb3a5-1c81-4b03-a13a-257fef56783b): created successfully Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b130db57-47ee-47f4-9f2f-0fbde518b2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Flow 'volume_create_manager' (10168f46-789e-4f99-a366-ef3b993acc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:33:54 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8ee1edab-325a-404e-a969-6236109f761d tempest-VolumesSnapshotTestJSON-1737189081 None] Created volume successfully. Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD" returned: 0 in 0.587s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 is fetched for user 8e10feba57054ae6ae85506db6b7cbf4. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6a711a-c014-46af-9a67-384963ee9da1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:54 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d Jul 28 16:33:54 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:54 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD Jul 28 16:33:54 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:55 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-a3fba08c-8629-4d72-b15f-82af2052a75e req-6cdbc51f-39de-45ff-a6bf-80cbd2e01126 tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d" returned: 0 in 0.587s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-a3fba08c-8629-4d72-b15f-82af2052a75e req-6cdbc51f-39de-45ff-a6bf-80cbd2e01126 tempest-TestStampPattern-1961021372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.710s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-a3fba08c-8629-4d72-b15f-82af2052a75e req-6cdbc51f-39de-45ff-a6bf-80cbd2e01126 tempest-TestStampPattern-1961021372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-c2e74201-1d11-4283-b31e-37306228757d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '973be7b3-4f44-4531-8f74-220ab7a1d4f7', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:33:55 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1611775294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053d3f14-dd9a-4149-b71c-7d9c22832891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45974f463ffb45a98b2df4361f3c6d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:33:52Z,use_quota=True,user_id='8e10feba57054ae6ae85506db6b7cbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Creating volume 053d3f14-dd9a-4149-b71c-7d9c22832891 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:33:55 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:55 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 1073741824 Jul 28 16:33:55 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-a3fba08c-8629-4d72-b15f-82af2052a75e req-6cdbc51f-39de-45ff-a6bf-80cbd2e01126 tempest-TestStampPattern-1961021372 None] attachment_update completed successfully. Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-e8fcb3a5-1c81-4b03-a13a-257fef56783b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-e8fcb3a5-1c81-4b03-a13a-257fef56783b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-e8fcb3a5-1c81-4b03-a13a-257fef56783b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-e8fcb3a5-1c81-4b03-a13a-257fef56783b" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb45dc2-9ef6-4550-b152-1c391582de81]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:55 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b Jul 28 16:33:55 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:55 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 1073741824" returned: 0 in 0.665s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:56 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 Jul 28 16:33:56 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:56 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b" returned: 0 in 0.581s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:56 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b Jul 28 16:33:56 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:56 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Attempting download of 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume 053d3f14-dd9a-4149-b71c-7d9c22832891. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[486771a6-12eb-49f5-9038-aed6eddec718]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_tpfacq3b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:56 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e8fcb3a5-1c81-4b03-a13a-257fef56783b" returned: 0 in 0.386s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-e8fcb3a5-1c81-4b03-a13a-257fef56783b" released by "delete_volume" :: held 1.035s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['70cf5be3-a938-4e25-ab0b-c90979b23e77', 'f18dcd1f-b76d-4fb7-92ff-cd326bc160ff', '74338f93-8c8e-45c9-81d1-898a4b75be43', '47e8078c-0176-4f43-87f3-4a1ccd52ed56'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:33:56 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_tpfacq3b Jul 28 16:33:56 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:33:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:56 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:33:56 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:57 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_tpfacq3b" returned: 0 in 0.542s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_tpfacq3b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:57 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:33:57 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_tpfacq3b Jul 28 16:33:57 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Deleted volume successfully. Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0454b35e-4cec-46a5-8106-5026767958ce tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-e8fcb3a5-1c81-4b03-a13a-257fef56783b-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:33:57 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_tpfacq3b" returned: 1 in 0.428s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80bdb979-36ce-4750-96f5-dc31bfd10d53_tpfacq3b' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[045ca62a-bf29-4ef0-90c5-d21233005400]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:57 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD Jul 28 16:33:57 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:57 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-0387ddea-dcc4-43f3-a0f2-a308dc264f9d-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] 80bdb979-36ce-4750-96f5-dc31bfd10d53 was qcow2, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:33:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:58 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 Jul 28 16:33:58 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-0387ddea-dcc4-43f3-a0f2-a308dc264f9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-a18e836c-150f-47de-ab46-fe51e59590c2" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-a18e836c-150f-47de-ab46-fe51e59590c2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-0387ddea-dcc4-43f3-a0f2-a308dc264f9d" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-0387ddea-dcc4-43f3-a0f2-a308dc264f9d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Deleting offline snapshot 0387ddea-dcc4-43f3-a0f2-a308dc264f9d of volume a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] snapshot_file for this snap is: volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84b9e24-d423-4bfd-871d-e71e9f8fc90b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:58 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d Jul 28 16:33:58 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:58 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d" returned: 0 in 0.517s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a18e836c-150f-47de-ab46-fe51e59590c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907c652-877b-4c9c-ae88-95d08e4e08f8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:58 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 Jul 28 16:33:58 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-bdd4432b-9512-4f1f-88f9-26c22f1ccca8 req-9edb6607-9291-4df1-a63e-ea8254a26b47 tempest-TestStampPattern-1961021372 None] Terminate volume connection completed successfully. Jul 28 16:33:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-bdd4432b-9512-4f1f-88f9-26c22f1ccca8 req-9edb6607-9291-4df1-a63e-ea8254a26b47 tempest-TestStampPattern-1961021372 None] Deleting attachment 973be7b3-4f44-4531-8f74-220ab7a1d4f7. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:33:59 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2" returned: 0 in 0.598s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:33:59 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d Jul 28 16:33:59 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:33:59 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 28 16:33:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d" returned: 0 in 0.665s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:33:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:00 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d Jul 28 16:34:00 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:00 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2.0387ddea-dcc4-43f3-a0f2-a308dc264f9d" returned: 0 in 0.444s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-0387ddea-dcc4-43f3-a0f2-a308dc264f9d" released by "_delete_snapshot" :: held 2.427s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-a18e836c-150f-47de-ab46-fe51e59590c2" released by "delete_snapshot" :: held 2.471s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['7fd975b6-b9ef-4972-b638-604a77ec2741', '6b53b539-b7ef-4fb2-9bfc-ed16dc070107', '7d66df13-1d7c-445d-bea3-993c8115133f', '9ebcd37d-b7b8-4848-b50f-aeb7a00675b9'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:00 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891" returned: 0 in 2.746s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80bdb979-36ce-4750-96f5-dc31bfd10d53_by5i8ie9devstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:34:00 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Converted 112.00 MB image at 40.77 MB/s Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:00 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 1G Jul 28 16:34:00 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Delete snapshot completed successfully. Jul 28 16:34:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5b0faef1-c54d-48a0-91ae-18a9fa3a1c4e tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-0387ddea-dcc4-43f3-a0f2-a308dc264f9d-delete_snapshot" released by "delete_snapshot" :: held 2.893s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:01 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 1G" returned: 0 in 0.682s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Downloaded image 80bdb979-36ce-4750-96f5-dc31bfd10d53 ((None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}])) to volume 053d3f14-dd9a-4149-b71c-7d9c22832891 successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Temporary image 80bdb979-36ce-4750-96f5-dc31bfd10d53 for user 8e10feba57054ae6ae85506db6b7cbf4 is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Marking volume 053d3f14-dd9a-4149-b71c-7d9c22832891 as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-a18e836c-150f-47de-ab46-fe51e59590c2-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Copying metadata from image 80bdb979-36ce-4750-96f5-dc31bfd10d53 to 053d3f14-dd9a-4149-b71c-7d9c22832891. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Creating volume glance metadata for volume 053d3f14-dd9a-4149-b71c-7d9c22832891 backed by image 80bdb979-36ce-4750-96f5-dc31bfd10d53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-a18e836c-150f-47de-ab46-fe51e59590c2-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-a18e836c-150f-47de-ab46-fe51e59590c2" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-a18e836c-150f-47de-ab46-fe51e59590c2" acquired by "delete_volume" :: waited 0.060s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef092e-22ec-41a2-b8fd-a27fe72c36fa]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d568d9-a081-418d-baf6-d75a22c7f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053d3f14-dd9a-4149-b71c-7d9c22832891', 'volume_size': 1, 'image_id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80bdb979-36ce-4750-96f5-dc31bfd10d53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '894089350c34468fabd3ece9cb42b6ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80bdb979-36ce-4750-96f5-dc31bfd10d53', 'created_at': datetime.datetime(2026, 7, 28, 14, 13, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 13, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80bdb979-36ce-4750-96f5-dc31bfd10d53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063ffc08-69b4-4475-a424-ce41649335ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Volume volume-053d3f14-dd9a-4149-b71c-7d9c22832891 (053d3f14-dd9a-4149-b71c-7d9c22832891): created successfully Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063ffc08-69b4-4475-a424-ce41649335ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Flow 'volume_create_manager' (06c73d2a-fda4-4885-b735-3c6d33d6a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a9660936-9623-4e8d-ae44-1a5289e3e4a3 tempest-TestShelveInstance-661069423 None] Created volume successfully. Jul 28 16:34:01 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 Jul 28 16:34:01 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:02 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2" returned: 0 in 0.592s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:02 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2 Jul 28 16:34:02 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:02 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a18e836c-150f-47de-ab46-fe51e59590c2" returned: 0 in 0.471s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-a18e836c-150f-47de-ab46-fe51e59590c2" released by "delete_volume" :: held 1.188s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['29fe5d8c-6eb6-4edf-81e7-288736cb63c6', '1048fa41-867e-40f7-a32d-e9484897a461', 'd5613fc4-382f-482f-b54f-02ac3b2d65b7', '5f7d4905-5cb8-4b6b-8a4e-ecaead21a2dd'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:03 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:03 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:03 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.423s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Deleted volume successfully. Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4846b37b-04d3-401b-9b1f-7af9ccd1f6da tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-a18e836c-150f-47de-ab46-fe51e59590c2-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-ab21696c-ba1a-4593-bc81-41ca6019698f-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-ab21696c-ba1a-4593-bc81-41ca6019698f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "cinder-quobyte-ab21696c-ba1a-4593-bc81-41ca6019698f" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-ab21696c-ba1a-4593-bc81-41ca6019698f" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:04 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c402bf-7a23-4137-97f3-b99587c06ae0]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:04 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f Jul 28 16:34:04 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:04 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f" returned: 0 in 0.540s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:04 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f Jul 28 16:34:04 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:05 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ab21696c-ba1a-4593-bc81-41ca6019698f" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-quobyte-ab21696c-ba1a-4593-bc81-41ca6019698f" released by "delete_volume" :: held 1.152s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Created reservations ['31cd5da5-dac0-4b1c-97ef-203ef0f6b175', 'ddb7fc35-bae1-4045-a5cc-1815d57682a3', 'd2f031e0-4c68-418b-a6bc-ba4225fe5221', '26f85fb0-1839-43ce-a2ef-dcf8266d7462'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-c2e74201-1d11-4283-b31e-37306228757d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Lock "cinder-c2e74201-1d11-4283-b31e-37306228757d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-quobyte-c2e74201-1d11-4283-b31e-37306228757d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-c2e74201-1d11-4283-b31e-37306228757d" acquired by "delete_volume" :: waited 0.116s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:05 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:05 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3271c0-24e3-4a76-a1a8-5be38835f1e9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:06 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d Jul 28 16:34:06 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:06 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.536s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:06 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:06 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Deleted volume successfully. Jul 28 16:34:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-04b68adc-56de-40e8-8f28-4a868a86ae60 tempest-VolumesSnapshotTestJSON-1737189081 None] Lock "cinder-ab21696c-ba1a-4593-bc81-41ca6019698f-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:06 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d" returned: 0 in 0.775s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:06 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d Jul 28 16:34:06 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:06 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c2e74201-1d11-4283-b31e-37306228757d" returned: 0 in 0.386s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-c2e74201-1d11-4283-b31e-37306228757d" released by "delete_volume" :: held 1.274s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Created reservations ['e44ba9ab-b98e-4e07-8f1f-8f45b865c5ca', 'e09f778d-7512-4ee0-987f-c60db3c0fcf7', 'cd4572fc-0e19-449d-b580-6396025c3404', '2785ce28-6275-4111-b86b-eebf22e81b05'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:07 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:07 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-13d9c912-551c-4bf3-9323-ea85dbdfc61b req-5051139a-ceee-4de3-9122-bf7ac872a7a8 tempest-TestShelveInstance-661069423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-13d9c912-551c-4bf3-9323-ea85dbdfc61b req-5051139a-ceee-4de3-9122-bf7ac872a7a8 tempest-TestShelveInstance-661069423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-13d9c912-551c-4bf3-9323-ea85dbdfc61b req-5051139a-ceee-4de3-9122-bf7ac872a7a8 tempest-TestShelveInstance-661069423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-13d9c912-551c-4bf3-9323-ea85dbdfc61b req-5051139a-ceee-4de3-9122-bf7ac872a7a8 tempest-TestShelveInstance-661069423 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-053d3f14-dd9a-4149-b71c-7d9c22832891', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b4e8603-d546-4253-85a0-c88c6cc04d42', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:34:07 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Deleted volume successfully. Jul 28 16:34:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-be47dd89-09e7-446c-80b4-06b78ea02d1e tempest-TestStampPattern-1961021372 None] Lock "cinder-c2e74201-1d11-4283-b31e-37306228757d-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-13d9c912-551c-4bf3-9323-ea85dbdfc61b req-5051139a-ceee-4de3-9122-bf7ac872a7a8 tempest-TestShelveInstance-661069423 None] attachment_update completed successfully. Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-9d397bbe-4623-4835-a116-c38747497365-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Lock "cinder-9d397bbe-4623-4835-a116-c38747497365-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-quobyte-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-quobyte-9d397bbe-4623-4835-a116-c38747497365" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-9d397bbe-4623-4835-a116-c38747497365" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Deleting offline snapshot 9d397bbe-4623-4835-a116-c38747497365 of volume f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] snapshot_file for this snap is: volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bc1dc9-87ad-43d1-bd75-ecc28538f712]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:08 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 Jul 28 16:34:08 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:08 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365" returned: 0 in 0.487s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[476b051b-0cc8-463b-9d98-9d996166e58d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:09 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 Jul 28 16:34:09 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:09 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" returned: 0 in 0.438s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:09 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 Jul 28 16:34:09 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:09 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365" returned: 0 in 0.545s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:09 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365 Jul 28 16:34:09 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:10 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3.9d397bbe-4623-4835-a116-c38747497365" returned: 0 in 0.330s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-9d397bbe-4623-4835-a116-c38747497365" released by "_delete_snapshot" :: held 1.963s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" released by "delete_snapshot" :: held 2.005s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:10 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Created reservations ['37aa1fcd-013b-45f1-aa3a-c9355fad74e8', '9aaf4db5-798f-4f75-bae9-9fd18c458543', '86cba7c8-1d7a-4e94-ac35-35edd2e28e81', '2c052a3a-54b8-4cfd-8392-2e24b24b5f2e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Delete snapshot completed successfully. Jul 28 16:34:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a75d7662-09cd-4b90-83df-1eb52151520d tempest-TestStampPattern-1961021372 None] Lock "cinder-9d397bbe-4623-4835-a116-c38747497365-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-f2a1aa57-ea1d-4c55-acd8-31f44627bff3-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Lock "cinder-f2a1aa57-ea1d-4c55-acd8-31f44627bff3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Acquiring lock "cinder-quobyte-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:20 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb06cc-ebc4-4793-beb1-3930482d098e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:20 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=74,cinder:UPDATE=93,cinder:DELETE=5,cinder:INSERT=29 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:34:20 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 Jul 28 16:34:20 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:21 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" returned: 0 in 1.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:21 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3 Jul 28 16:34:21 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:22 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" returned: 0 in 0.598s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Lock "cinder-quobyte-f2a1aa57-ea1d-4c55-acd8-31f44627bff3" released by "delete_volume" :: held 2.099s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Created reservations ['a1bcca57-a3d7-4633-8f53-e210e7498e94', 'a777901b-1265-4141-9102-8eadca76e096', '392a50a2-af16-455d-b9f6-a436ada3bf4d', 'c2a57967-8250-4e1a-bd9c-86c1798966ee'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:22 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:22 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:23 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.653s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:23 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Deleted volume successfully. Jul 28 16:34:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-235a3081-8813-4ff8-bf9a-1debcf6cbfd1 tempest-TestStampPattern-1961021372 None] Lock "cinder-f2a1aa57-ea1d-4c55-acd8-31f44627bff3-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:33 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:34:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=76,cinder:SELECT=89,cinder:INSERT=25,cinder:DELETE=6 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:41 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:41 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:41 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.395s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:34:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Flow 'volume_create_manager' (46e04ab6-fd41-4ecc-8537-e80971024387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7633bce-e755-480b-b9d0-2e288f8b186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7633bce-e755-480b-b9d0-2e288f8b186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-778223108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d085376-2655-484a-ae4f-c076211c2ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155c8fbac60448249c2cafffaab16f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:43Z,use_quota=True,user_id='7d3a8cf9e5354681b874fd56bb87165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb5cabf-289f-4f22-9adc-293131d607f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb5cabf-289f-4f22-9adc-293131d607f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd36238-1854-4c89-b97a-2ca976c59762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd36238-1854-4c89-b97a-2ca976c59762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d085376-2655-484a-ae4f-c076211c2ea6', 'volume_name': 'volume-9d085376-2655-484a-ae4f-c076211c2ea6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44998ec-535d-4991-8bd2-0a2f0189897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44998ec-535d-4991-8bd2-0a2f0189897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6162ddbe-5b79-4922-8760-833a24d94c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:43 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Volume 9d085376-2655-484a-ae4f-c076211c2ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d085376-2655-484a-ae4f-c076211c2ea6', 'volume_size': 1} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-778223108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d085376-2655-484a-ae4f-c076211c2ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155c8fbac60448249c2cafffaab16f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:43Z,use_quota=True,user_id='7d3a8cf9e5354681b874fd56bb87165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Creating volume 9d085376-2655-484a-ae4f-c076211c2ea6 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:43 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:43 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 1073741824 Jul 28 16:34:43 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:44 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 1073741824" returned: 0 in 0.735s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:44 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 Jul 28 16:34:44 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (9a8234b9-0407-4c98-af3a-2aa1ea3c0863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1561c9e5-5520-4f6f-a4bc-720fc782fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1561c9e5-5520-4f6f-a4bc-720fc782fab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206112311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:45Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defdaf5f-28f3-4da7-a85e-7446a2c56415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defdaf5f-28f3-4da7-a85e-7446a2c56415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489d3623-3a4f-410f-9435-37cda9b30c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489d3623-3a4f-410f-9435-37cda9b30c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73', 'volume_name': 'volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2201d43e-4646-41e7-9bd6-d4203486795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2201d43e-4646-41e7-9bd6-d4203486795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c840b2be-da8a-4615-98f7-9713324a82d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Volume a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73', 'volume_size': 1} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:44 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6" returned: 0 in 0.446s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206112311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:45Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Creating volume a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:44 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 1073741824 Jul 28 16:34:44 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6162ddbe-5b79-4922-8760-833a24d94c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d085376-2655-484a-ae4f-c076211c2ea6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9b9695-fa3d-4548-ad6b-6413843b5f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Volume volume-9d085376-2655-484a-ae4f-c076211c2ea6 (9d085376-2655-484a-ae4f-c076211c2ea6): created successfully Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9b9695-fa3d-4548-ad6b-6413843b5f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Flow 'volume_create_manager' (46e04ab6-fd41-4ecc-8537-e80971024387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f9eb1e63-8efc-42df-b933-18cfe89f33e6 tempest-AttachVolumeTestJSON-200322447 None] Created volume successfully. Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (b4e7923d-b1e8-4473-ae39-8f125911758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5dcca3-07d3-49e8-8d24-d535d9ddf186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5dcca3-07d3-49e8-8d24-d535d9ddf186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-261014704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:45Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d3a808-7ede-4d7c-8e31-f05cae96a66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d3a808-7ede-4d7c-8e31-f05cae96a66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35f2df8-bf85-4c5f-83c8-1ec0e7a7ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35f2df8-bf85-4c5f-83c8-1ec0e7a7ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22', 'volume_name': 'volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62348bdc-dcdf-4c74-920e-111ca730e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62348bdc-dcdf-4c74-920e-111ca730e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32740d14-4339-4fd0-b399-73f9e7d7cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Volume ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22', 'volume_size': 1} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:45 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 1073741824" returned: 0 in 0.703s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:45 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 Jul 28 16:34:45 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (39f93895-a275-4bd2-a95f-51f946a218b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1921a07d-2f27-4c81-b7a8-e2dc58335283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1921a07d-2f27-4c81-b7a8-e2dc58335283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1715050159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58de2cc-fec2-4c31-a492-5c83b304920f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:46Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a95d26-826e-41cb-9253-41402cf13daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a95d26-826e-41cb-9253-41402cf13daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f397beca-5ecd-45d9-a067-489c8dbf0fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f397beca-5ecd-45d9-a067-489c8dbf0fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58de2cc-fec2-4c31-a492-5c83b304920f', 'volume_name': 'volume-d58de2cc-fec2-4c31-a492-5c83b304920f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0e54ab-27f3-49f0-8693-101f3126d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0e54ab-27f3-49f0-8693-101f3126d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f15ea1-0308-47b0-9d5e-6c645407d4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Volume d58de2cc-fec2-4c31-a492-5c83b304920f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58de2cc-fec2-4c31-a492-5c83b304920f', 'volume_size': 1} Jul 28 16:34:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:46 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73" returned: 0 in 0.411s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-261014704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:45Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Creating volume ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:46 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c840b2be-da8a-4615-98f7-9713324a82d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:46 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 1073741824 Jul 28 16:34:46 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4b50c0-aa59-4c73-be8a-26b9631531a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Volume volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 (a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73): created successfully Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4b50c0-aa59-4c73-be8a-26b9631531a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (9a8234b9-0407-4c98-af3a-2aa1ea3c0863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d16c16cb-a385-4917-b8c2-514ffea44653 tempest-CreateVolumesFromImageTest-2044041370 None] Created volume successfully. Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (e7c9cb3a-c589-4e3f-b4e2-148faa9ec9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a32c0bb-705a-40a8-8684-06726f660c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a32c0bb-705a-40a8-8684-06726f660c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2035558040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3620a809-3301-4939-8a3d-57a7a40873d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:47Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8895bee-d7d3-4f05-988f-d1481c206823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8895bee-d7d3-4f05-988f-d1481c206823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97688408-68dd-471d-bacd-80d964b8f23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97688408-68dd-471d-bacd-80d964b8f23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3620a809-3301-4939-8a3d-57a7a40873d9', 'volume_name': 'volume-3620a809-3301-4939-8a3d-57a7a40873d9', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb734893-39db-4fc1-8734-d6e7fa819ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb734893-39db-4fc1-8734-d6e7fa819ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd98c96-6179-4513-8d70-cb971c923334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Volume 3620a809-3301-4939-8a3d-57a7a40873d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3620a809-3301-4939-8a3d-57a7a40873d9', 'volume_size': 1} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:47 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 1073741824" returned: 0 in 1.264s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee6068bc-bf32-4a4a-b2d7-18cab1104b55 req-0c78688d-9e78-4b8a-865f-1f4a2336f562 tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:47 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 Jul 28 16:34:47 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (9ebb6b9d-761f-4a82-96a8-1e25c128ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84808f26-4dd7-4597-a03f-eaee35c9e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84808f26-4dd7-4597-a03f-eaee35c9e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1970011859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:48Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebbcf4e-68b2-4d2b-bc3b-2d48d7554d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebbcf4e-68b2-4d2b-bc3b-2d48d7554d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2189351b-a347-4485-8ae3-bef163e2de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2189351b-a347-4485-8ae3-bef163e2de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053', 'volume_name': 'volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839dcade-386c-4ffb-b259-ea59b551400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839dcade-386c-4ffb-b259-ea59b551400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbb5393-3578-4020-ab14-34b57386cc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Volume 0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053', 'volume_size': 1} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:47 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22" returned: 0 in 0.390s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1715050159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58de2cc-fec2-4c31-a492-5c83b304920f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:46Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Creating volume d58de2cc-fec2-4c31-a492-5c83b304920f {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:47 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32740d14-4339-4fd0-b399-73f9e7d7cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caad9854-3be4-4693-aaf8-bebf1f2f40c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:48 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f 1073741824 Jul 28 16:34:48 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:48 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Volume volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 (ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22): created successfully Jul 28 16:34:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caad9854-3be4-4693-aaf8-bebf1f2f40c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (b4e7923d-b1e8-4473-ae39-8f125911758d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:48 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3554370d-25d7-4793-ad90-bd05dd17cd4b tempest-CreateVolumesFromImageTest-2044041370 None] Created volume successfully. Jul 28 16:34:48 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f 1073741824" returned: 0 in 0.679s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:48 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f Jul 28 16:34:48 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:49 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f" returned: 0 in 0.306s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.023s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2035558040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3620a809-3301-4939-8a3d-57a7a40873d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:47Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Creating volume 3620a809-3301-4939-8a3d-57a7a40873d9 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:49 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f15ea1-0308-47b0-9d5e-6c645407d4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58de2cc-fec2-4c31-a492-5c83b304920f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea17605-921b-4868-8ffd-1e0956d2a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:49 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 1073741824 Jul 28 16:34:49 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:49 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Volume volume-d58de2cc-fec2-4c31-a492-5c83b304920f (d58de2cc-fec2-4c31-a492-5c83b304920f): created successfully Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea17605-921b-4868-8ffd-1e0956d2a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (39f93895-a275-4bd2-a95f-51f946a218b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6166251a-82d8-478f-887f-c973ee37b901 tempest-CreateVolumesFromImageTest-2044041370 None] Created volume successfully. Jul 28 16:34:49 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 1073741824" returned: 0 in 0.930s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:50 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 Jul 28 16:34:50 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:50 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9" returned: 0 in 0.416s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee6068bc-bf32-4a4a-b2d7-18cab1104b55 req-0c78688d-9e78-4b8a-865f-1f4a2336f562 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.046s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee6068bc-bf32-4a4a-b2d7-18cab1104b55 req-0c78688d-9e78-4b8a-865f-1f4a2336f562 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.780s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1970011859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d839804b974059b623e1b369396dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:48Z,use_quota=True,user_id='8080770ef4b546b0a9465c84e1cee296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Creating volume 0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:50 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd98c96-6179-4513-8d70-cb971c923334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3620a809-3301-4939-8a3d-57a7a40873d9', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71d2c7-2c6c-4500-a0c6-2810378e4405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:50 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 1073741824 Jul 28 16:34:50 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Volume volume-3620a809-3301-4939-8a3d-57a7a40873d9 (3620a809-3301-4939-8a3d-57a7a40873d9): created successfully Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71d2c7-2c6c-4500-a0c6-2810378e4405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (e7c9cb3a-c589-4e3f-b4e2-148faa9ec9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-34a3e429-1cd4-47a1-b3a0-84fe01637898 tempest-CreateVolumesFromImageTest-2044041370 None] Created volume successfully. Jul 28 16:34:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee6068bc-bf32-4a4a-b2d7-18cab1104b55 req-0c78688d-9e78-4b8a-865f-1f4a2336f562 tempest-AttachVolumeTestJSON-200322447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-9d085376-2655-484a-ae4f-c076211c2ea6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d64dc30-20d7-4848-bc20-eda49c6dbb82', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:34:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-ee6068bc-bf32-4a4a-b2d7-18cab1104b55 req-0c78688d-9e78-4b8a-865f-1f4a2336f562 tempest-AttachVolumeTestJSON-200322447 None] attachment_update completed successfully. Jul 28 16:34:51 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 1073741824" returned: 0 in 0.847s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:51 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 Jul 28 16:34:51 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:51 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053" returned: 0 in 0.448s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbb5393-3578-4020-ab14-34b57386cc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68bbf35-68ec-4d6b-b972-17147acdf554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Volume volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 (0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053): created successfully Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68bbf35-68ec-4d6b-b972-17147acdf554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Flow 'volume_create_manager' (9ebb6b9d-761f-4a82-96a8-1e25c128ab91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b16fc53a-539a-40a4-a16b-071de8da5a66 tempest-CreateVolumesFromImageTest-2044041370 None] Created volume successfully. Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-quobyte-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3383aa-ada1-4513-a511-5632e0a3cecf]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:52 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 Jul 28 16:34:52 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:53 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053" returned: 0 in 0.575s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:53 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053 Jul 28 16:34:53 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:53 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Flow 'volume_create_manager' (c7a0d6cf-4329-44ce-836c-066f23790369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4904e0bc-b72d-4905-96ea-a737e58d2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053" returned: 0 in 0.568s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4904e0bc-b72d-4905-96ea-a737e58d2a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263095714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b4bd82-630a-4cec-93b0-a863c77ab7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155c8fbac60448249c2cafffaab16f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:54Z,use_quota=True,user_id='7d3a8cf9e5354681b874fd56bb87165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65885770-d8c2-43a7-a357-787496f0037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65885770-d8c2-43a7-a357-787496f0037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b5ab9-eca2-4203-ba4d-bbf7ad934437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b5ab9-eca2-4203-ba4d-bbf7ad934437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b4bd82-630a-4cec-93b0-a863c77ab7f8', 'volume_name': 'volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485b3301-157e-4bdf-a88f-4a6c7f481909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485b3301-157e-4bdf-a88f-4a6c7f481909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83afeec-fd39-4c11-9482-39bf06d48828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Volume 89b4bd82-630a-4cec-93b0-a863c77ab7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8', 'volume_size': 1} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263095714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b4bd82-630a-4cec-93b0-a863c77ab7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155c8fbac60448249c2cafffaab16f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:54Z,use_quota=True,user_id='7d3a8cf9e5354681b874fd56bb87165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Creating volume 89b4bd82-630a-4cec-93b0-a863c77ab7f8 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:53 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053" released by "delete_volume" :: held 1.297s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:53 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 1073741824 Jul 28 16:34:53 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:53 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Created reservations ['66c6e38a-f6d7-4e37-9914-9795cf02061c', '8acedd13-0a3f-4aba-a85b-f5ad9cfcda79', '663351ce-bd2f-4237-8a35-263eaaeb369d', 'd57d3886-2f07-490f-b3ae-01d4639557da'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:54 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:54 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:54 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.522s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Deleted volume successfully. Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-73aebc90-b126-44bd-8933-751d09db3936 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-0e0b2bd9-8b7a-4199-a5ab-9f8a7a23a053-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:54 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 1073741824" returned: 0 in 0.931s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-3620a809-3301-4939-8a3d-57a7a40873d9-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-3620a809-3301-4939-8a3d-57a7a40873d9-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:54 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 Jul 28 16:34:54 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-quobyte-3620a809-3301-4939-8a3d-57a7a40873d9" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-3620a809-3301-4939-8a3d-57a7a40873d9" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c69599-daf4-4b78-a68b-3150be44660a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:55 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8" returned: 0 in 0.439s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83afeec-fd39-4c11-9482-39bf06d48828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:55 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 Jul 28 16:34:55 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927f4200-c9b8-4d23-802e-db15c8c8147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:55 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Volume volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 (89b4bd82-630a-4cec-93b0-a863c77ab7f8): created successfully Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927f4200-c9b8-4d23-802e-db15c8c8147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Flow 'volume_create_manager' (c7a0d6cf-4329-44ce-836c-066f23790369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b92f07bc-06c3-43ff-8714-90ec82b20a83 tempest-AttachVolumeTestJSON-200322447 None] Created volume successfully. Jul 28 16:34:56 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9" returned: 0 in 1.022s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:56 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9 Jul 28 16:34:56 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:56 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-fa4e48fb-4bc4-4580-be85-ae7ad59b9e3d req-df4bc532-a771-463b-aa2b-17e70ddeb1b9 tempest-TestShelveInstance-661069423 None] Terminate volume connection completed successfully. Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-fa4e48fb-4bc4-4580-be85-ae7ad59b9e3d req-df4bc532-a771-463b-aa2b-17e70ddeb1b9 tempest-TestShelveInstance-661069423 None] Deleting attachment 7b4e8603-d546-4253-85a0-c88c6cc04d42. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:34:56 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3620a809-3301-4939-8a3d-57a7a40873d9" returned: 0 in 0.495s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-3620a809-3301-4939-8a3d-57a7a40873d9" released by "delete_volume" :: held 1.584s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Flow 'volume_create_manager' (1a818147-5e98-4fd6-9ccc-e2c0c5228add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae3f5c9-d940-41ee-a040-9620e4514fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Created reservations ['5962164a-b898-47fe-9573-dcac4df6ea65', '37012383-324b-4621-9450-f3d6f83f93da', '57503ba3-b5f3-4aa8-b614-f49f64b0e5ba', '1576fe0e-a8d4-41e8-98cd-04a702d506a5'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae3f5c9-d940-41ee-a040-9620e4514fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-630546829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ad6124a93747b78d41327ec38db672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:56Z,use_quota=True,user_id='db4ec5d8d00349a1b00bbadddac04576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9901bd5d-ea16-40d5-a2dd-7df9704fb123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9901bd5d-ea16-40d5-a2dd-7df9704fb123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8b60c1-27f9-4cf1-a545-af1427a9ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8b60c1-27f9-4cf1-a545-af1427a9ecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21', 'volume_name': 'volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944b3505-31e8-419c-8a5a-0f08ab32c879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944b3505-31e8-419c-8a5a-0f08ab32c879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ade520-4a94-4541-9828-5885c6fa383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:56 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Volume ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21', 'volume_size': 1} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-630546829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ad6124a93747b78d41327ec38db672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:56Z,use_quota=True,user_id='db4ec5d8d00349a1b00bbadddac04576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Creating volume ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:56 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:57 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 1073741824 Jul 28 16:34:57 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:57 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:57 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-d58de2cc-fec2-4c31-a492-5c83b304920f-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-d58de2cc-fec2-4c31-a492-5c83b304920f-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-quobyte-d58de2cc-fec2-4c31-a492-5c83b304920f" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Flow 'volume_create_manager' (db07ecd9-d673-4658-b2f1-deef26f0d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3967b16-8863-4bf9-9e01-b5582580093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-d58de2cc-fec2-4c31-a492-5c83b304920f" acquired by "delete_volume" :: waited 0.110s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3967b16-8863-4bf9-9e01-b5582580093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1899530916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3836bde7-0a76-4cfe-a3fc-d9e8755c6c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ad6124a93747b78d41327ec38db672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:58Z,use_quota=True,user_id='db4ec5d8d00349a1b00bbadddac04576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21408980-8325-4621-98c5-28b27e5d2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21408980-8325-4621-98c5-28b27e5d2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7dcd68-09be-4f10-b967-2f4cf28ed92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7dcd68-09be-4f10-b967-2f4cf28ed92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3836bde7-0a76-4cfe-a3fc-d9e8755c6c98', 'volume_name': 'volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:58 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae05abb-edde-40b9-9550-2c97bc27ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae05abb-edde-40b9-9550-2c97bc27ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eeb010e-df74-4a31-83a4-252719748901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:58 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:58 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Volume 3836bde7-0a76-4cfe-a3fc-d9e8755c6c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98', 'volume_size': 1} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade0e570-2b2a-4a36-aaa1-e7092cfe2ead]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 1073741824" returned: 0 in 1.109s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.841s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Deleted volume successfully. Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a3dc464d-46b1-447a-9bcf-130822b35383 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-3620a809-3301-4939-8a3d-57a7a40873d9-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-084d7959-1a29-4a7a-bf3b-b306cc37fcfe req-12086e2a-d98f-48d4-b946-ee219c15d406 tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:58 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 Jul 28 16:34:58 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:58 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f Jul 28 16:34:58 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:58 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21" returned: 0 in 0.370s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1899530916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3836bde7-0a76-4cfe-a3fc-d9e8755c6c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ad6124a93747b78d41327ec38db672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:34:58Z,use_quota=True,user_id='db4ec5d8d00349a1b00bbadddac04576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Creating volume 3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:34:58 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:58 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 1073741824 Jul 28 16:34:58 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ade520-4a94-4541-9828-5885c6fa383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7ff2e7-8b9f-463d-9203-e5469f8a79ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:34:58 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Volume volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 (ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21): created successfully Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7ff2e7-8b9f-463d-9203-e5469f8a79ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Flow 'volume_create_manager' (1a818147-5e98-4fd6-9ccc-e2c0c5228add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:34:58 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f" returned: 0 in 0.753s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-aea4fa26-4b8e-4928-8ec5-7e0217e50fc6 tempest-TestServerVolumeAttachmentScenario-735847450 None] Created volume successfully. Jul 28 16:34:58 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f Jul 28 16:34:58 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:59 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-d58de2cc-fec2-4c31-a492-5c83b304920f" returned: 0 in 0.365s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-d58de2cc-fec2-4c31-a492-5c83b304920f" released by "delete_volume" :: held 1.323s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Created reservations ['90d78de5-7fe2-4b96-a3b0-a1a3260b3215', '7f5550c7-2ad8-4bb4-b7e0-2bd89261a4b8', 'bdba47a9-bb70-4001-aee0-e86590c7166c', '241c91b9-89e7-4058-a15d-69f7dfe89504'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:34:59 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 1073741824" returned: 0 in 0.692s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:34:59 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 Jul 28 16:34:59 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:34:59 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:34:59 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:34:59 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98" returned: 0 in 0.302s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-084d7959-1a29-4a7a-bf3b-b306cc37fcfe req-12086e2a-d98f-48d4-b946-ee219c15d406 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.477s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-084d7959-1a29-4a7a-bf3b-b306cc37fcfe req-12086e2a-d98f-48d4-b946-ee219c15d406 tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:34:59 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:34:59 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:34:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Deleted volume successfully. Jul 28 16:35:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7bcd91ac-fd4e-4390-bcbd-a5e87dde3bd8 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-d58de2cc-fec2-4c31-a492-5c83b304920f-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eeb010e-df74-4a31-83a4-252719748901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949af385-5022-4545-bc52-fce2adaa559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-084d7959-1a29-4a7a-bf3b-b306cc37fcfe req-12086e2a-d98f-48d4-b946-ee219c15d406 tempest-AttachVolumeTestJSON-200322447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '233f66d2-7b0c-411e-8c1a-6d950be1f913', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:35:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Volume volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 (3836bde7-0a76-4cfe-a3fc-d9e8755c6c98): created successfully Jul 28 16:35:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949af385-5022-4545-bc52-fce2adaa559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Flow 'volume_create_manager' (db07ecd9-d673-4658-b2f1-deef26f0d33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-084d7959-1a29-4a7a-bf3b-b306cc37fcfe req-12086e2a-d98f-48d4-b946-ee219c15d406 tempest-AttachVolumeTestJSON-200322447 None] attachment_update completed successfully. Jul 28 16:35:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5ee71afe-5284-4f59-9a43-055dd3734b67 tempest-TestServerVolumeAttachmentScenario-735847450 None] Created volume successfully. Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-quobyte-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3269a9b-ab07-4c97-a2fb-e5a4dc1268a2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:03 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 Jul 28 16:35:03 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:03 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22" returned: 0 in 0.423s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:03 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22 Jul 28 16:35:03 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:03 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22" returned: 0 in 0.255s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22" released by "delete_volume" :: held 0.742s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:04 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Created reservations ['b62c68cb-657d-4972-9db2-8f949a90419a', 'f8a6826e-8b0a-4350-aa37-919086a08e6d', 'e4adf91a-8129-4596-acf6-1d8944dec677', '0e29aebf-9f91-48ab-960f-e4cb8c14e130'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:05 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:05 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:05 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.322s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Deleted volume successfully. Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c0c973d4-f804-48bd-82b3-0622aac54a33 tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-ff1e9648-fd4a-45d5-bfd0-7a7218ebbb22-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "cinder-quobyte-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[44366d7f-1af7-422e-b92d-c833f5335dae]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-21a68495-a990-4dfd-98a8-3d1267358e50 req-1d06c1d0-d1c1-4733-9d33-02de283eeca8 tempest-TestShelveInstance-661069423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-21a68495-a990-4dfd-98a8-3d1267358e50 req-1d06c1d0-d1c1-4733-9d33-02de283eeca8 tempest-TestShelveInstance-661069423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:06 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 Jul 28 16:35:06 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-21a68495-a990-4dfd-98a8-3d1267358e50 req-1d06c1d0-d1c1-4733-9d33-02de283eeca8 tempest-TestShelveInstance-661069423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:06 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-21a68495-a990-4dfd-98a8-3d1267358e50 req-1d06c1d0-d1c1-4733-9d33-02de283eeca8 tempest-TestShelveInstance-661069423 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-053d3f14-dd9a-4149-b71c-7d9c22832891', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b48d579-a543-4bd5-8ee1-983c7ef40bac', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:35:06 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-21a68495-a990-4dfd-98a8-3d1267358e50 req-1d06c1d0-d1c1-4733-9d33-02de283eeca8 tempest-TestShelveInstance-661069423 None] attachment_update completed successfully. Jul 28 16:35:06 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73" returned: 0 in 0.635s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:06 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73 Jul 28 16:35:06 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:07 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73" returned: 0 in 0.503s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-quobyte-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73" released by "delete_volume" :: held 1.239s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Created reservations ['59e889be-25e6-4947-9a68-2682ffbde45f', '8d4cc3a2-6d14-4812-a191-9d4e933cd3f7', 'b41fe15d-c93d-49e1-b842-17723bd9681e', '4994554c-97a7-4308-927f-44d03d358624'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:07 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:07 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-f36a2967-e80c-4d5b-9fb3-cbb25b44efc5 req-d264dece-972e-4061-9296-3ad24f3ffc2e tempest-AttachVolumeTestJSON-200322447 None] Terminate volume connection completed successfully. Jul 28 16:35:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-f36a2967-e80c-4d5b-9fb3-cbb25b44efc5 req-d264dece-972e-4061-9296-3ad24f3ffc2e tempest-AttachVolumeTestJSON-200322447 None] Deleting attachment 2d64dc30-20d7-4848-bc20-eda49c6dbb82. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:35:08 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.464s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:08 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Deleted volume successfully. Jul 28 16:35:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1006caed-6bec-4e0e-8dc4-19618d41ff6c tempest-CreateVolumesFromImageTest-2044041370 None] Lock "cinder-a4a49e8c-df1a-4a10-bb09-c2d2ad1b4b73-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-0a58cd2d-0611-4a10-ab6c-d99693699294 req-1f031387-d4c2-4abe-afa6-5848f371586f tempest-AttachVolumeTestJSON-200322447 None] Terminate volume connection completed successfully. Jul 28 16:35:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-0a58cd2d-0611-4a10-ab6c-d99693699294 req-1f031387-d4c2-4abe-afa6-5848f371586f tempest-AttachVolumeTestJSON-200322447 None] Deleting attachment 233f66d2-7b0c-411e-8c1a-6d950be1f913. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Flow 'volume_create_manager' (67a1d8ce-6f1c-4771-8d08-6b4bd321f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69753fcc-5b69-40ed-a061-57b8d4266dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69753fcc-5b69-40ed-a061-57b8d4266dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1251131668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e032721-8da5-43d8-b9b0-5a5305b8b25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7453658012eb4e9f9b319f1269da4e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:15Z,use_quota=True,user_id='12ad3338d9f04936b7db979079058393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e07573-ac01-4366-ab43-b03efd5d9815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e07573-ac01-4366-ab43-b03efd5d9815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9d49c7-ed42-4978-a5aa-a66a9e37716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9d49c7-ed42-4978-a5aa-a66a9e37716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e032721-8da5-43d8-b9b0-5a5305b8b25b', 'volume_name': 'volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e12461-b947-4c78-ba97-ca06608a369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e12461-b947-4c78-ba97-ca06608a369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cb006-bb41-4fa6-9ffd-66c6de36a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Volume 4e032721-8da5-43d8-b9b0-5a5305b8b25b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b', 'volume_size': 1} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1251131668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e032721-8da5-43d8-b9b0-5a5305b8b25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7453658012eb4e9f9b319f1269da4e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:15Z,use_quota=True,user_id='12ad3338d9f04936b7db979079058393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Creating volume 4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:35:15 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:35:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:15 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b 1073741824 Jul 28 16:35:15 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:16 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b 1073741824" returned: 0 in 1.024s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:16 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b Jul 28 16:35:16 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:17 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b" returned: 0 in 0.419s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cb006-bb41-4fa6-9ffd-66c6de36a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28dcfbc-f13e-488f-94fe-5ac3f19506fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:17 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Volume volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b (4e032721-8da5-43d8-b9b0-5a5305b8b25b): created successfully Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28dcfbc-f13e-488f-94fe-5ac3f19506fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Flow 'volume_create_manager' (67a1d8ce-6f1c-4771-8d08-6b4bd321f750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d1dac57f-0c47-46dd-ba29-78332c1e8ce4 tempest-VolumeDependencyTests-634914822 None] Created volume successfully. Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Creating offline snapshot a6a12565-9228-47a2-bbc7-2bd1baadaf9d of volume 4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfbabd0-e713-4973-9727-4488ec7a7ca1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:18 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b Jul 28 16:35:18 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:18 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b" returned: 0 in 0.821s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:18 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d 1G Jul 28 16:35:18 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "cinder-89b4bd82-630a-4cec-93b0-a863c77ab7f8-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-89b4bd82-630a-4cec-93b0-a863c77ab7f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "cinder-quobyte-89b4bd82-630a-4cec-93b0-a863c77ab7f8" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-quobyte-89b4bd82-630a-4cec-93b0-a863c77ab7f8" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:19 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7396bd9-a185-4e74-a03d-13a9e3594694]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:19 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 Jul 28 16:35:19 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:19 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d 1G" returned: 0 in 0.924s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:19 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d Jul 28 16:35:19 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:20 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8" returned: 0 in 0.970s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:20 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8 Jul 28 16:35:20 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:20 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d" returned: 0 in 0.731s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:20 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d is being set with open permissions: ugo+rw Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:20 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d Jul 28 16:35:20 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:20 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d" returned: 0 in 0.438s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:20 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-89b4bd82-630a-4cec-93b0-a863c77ab7f8" returned: 0 in 0.810s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-quobyte-89b4bd82-630a-4cec-93b0-a863c77ab7f8" released by "delete_volume" :: held 1.860s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:20 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.info Jul 28 16:35:20 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:20 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Created reservations ['58ef4da8-8f48-4bd0-9719-94838fe7c86f', 'f205c0e0-3b8d-41f4-a19d-4760d20a8af4', '70aaf730-217a-403e-b7f4-b3671df26163', '740c8803-83ba-4295-a5dd-9e38520128cd'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:21 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:21 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:21 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.info" returned: 0 in 0.375s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:21 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.info is being set with open permissions: ugo+rw Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:21 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.info Jul 28 16:35:21 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "cinder-9d085376-2655-484a-ae4f-c076211c2ea6-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-9d085376-2655-484a-ae4f-c076211c2ea6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "cinder-quobyte-9d085376-2655-484a-ae4f-c076211c2ea6" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-quobyte-9d085376-2655-484a-ae4f-c076211c2ea6" acquired by "delete_volume" :: waited 0.047s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d3e4a2-3266-4870-8963-3ddbdb2f8037]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:21 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.607s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Deleted volume successfully. Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8bc22823-2f1d-4657-aee3-72638f7053bc tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-89b4bd82-630a-4cec-93b0-a863c77ab7f8-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:21 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.info" returned: 0 in 0.681s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.161s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:22 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 Jul 28 16:35:22 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d433d70e-981e-45c7-8ae3-8a1b5c000d30 tempest-VolumeDependencyTests-634914822 None] Create snapshot completed successfully Jul 28 16:35:22 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6" returned: 0 in 0.820s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:22 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6 Jul 28 16:35:22 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:22 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9d085376-2655-484a-ae4f-c076211c2ea6" returned: 0 in 0.383s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-quobyte-9d085376-2655-484a-ae4f-c076211c2ea6" released by "delete_volume" :: held 1.288s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Created reservations ['2eb44ab9-a677-4246-97ab-3af90241f81f', 'f75f6761-9cd9-4bdc-956c-dc9a782c7731', '4196333c-1814-4a27-bf9a-2afe9c23ec89', '273db328-d21c-41a8-af22-e089668854a1'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:23 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:23 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:23 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.515s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Deleted volume successfully. Jul 28 16:35:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-090bf6cb-1001-4d4f-aaa1-3f919b46898a tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-9d085376-2655-484a-ae4f-c076211c2ea6-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "cinder-30a50bed-4a45-49de-b942-73975c03fd39-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-30a50bed-4a45-49de-b942-73975c03fd39-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "cinder-quobyte-30a50bed-4a45-49de-b942-73975c03fd39" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Flow 'volume_create_manager' (bea0750e-751e-4071-aa84-4f241de107a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619b50eb-f94a-4716-bdd0-8a6e03ceb729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-quobyte-30a50bed-4a45-49de-b942-73975c03fd39" acquired by "delete_volume" :: waited 0.080s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619b50eb-f94a-4716-bdd0-8a6e03ceb729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1805153300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f015bf0-ef3b-4531-ad6d-3fac54d43a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7453658012eb4e9f9b319f1269da4e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6a12565-9228-47a2-bbc7-2bd1baadaf9d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:24Z,use_quota=True,user_id='12ad3338d9f04936b7db979079058393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e32f00a-8555-4209-b1c1-361f7673d018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e32f00a-8555-4209-b1c1-361f7673d018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8f4189-21d9-47f0-aa13-32a94bb5fe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8f4189-21d9-47f0-aa13-32a94bb5fe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f015bf0-ef3b-4531-ad6d-3fac54d43a9b', 'volume_name': 'volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b', 'volume_size': 1, 'snapshot_id': 'a6a12565-9228-47a2-bbc7-2bd1baadaf9d'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645d9be1-19eb-4df3-a180-70583febe4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645d9be1-19eb-4df3-a180-70583febe4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905b4df8-1f63-4950-9665-533c18cf9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:24 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Volume 4f015bf0-ef3b-4531-ad6d-3fac54d43a9b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b', 'volume_size': 1, 'snapshot_id': 'a6a12565-9228-47a2-bbc7-2bd1baadaf9d'} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d264b56-3d14-494c-b239-c8af6b305a4c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-quobyte-a6a12565-9228-47a2-bbc7-2bd1baadaf9d-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-a6a12565-9228-47a2-bbc7-2bd1baadaf9d-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Creating volume 4f015bf0-ef3b-4531-ad6d-3fac54d43a9b from snapshot a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-quobyte-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] snapshot: a6a12565-9228-47a2-bbc7-2bd1baadaf9d, volume: 4f015bf0-ef3b-4531-ad6d-3fac54d43a9b, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2800a7-5bfd-445b-8259-1d0da04eebe5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:24 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 Jul 28 16:35:24 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:25 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d Jul 28 16:35:25 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:25 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39" returned: 0 in 0.990s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:25 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39 Jul 28 16:35:25 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:25 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d" returned: 0 in 0.919s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c502c6e-2725-4759-85a8-4d597a48fa94]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:26 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b Jul 28 16:35:26 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:26 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-30a50bed-4a45-49de-b942-73975c03fd39" returned: 0 in 0.549s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-quobyte-30a50bed-4a45-49de-b942-73975c03fd39" released by "delete_volume" :: held 1.666s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Created reservations ['5dab4ee6-6a11-4e63-a7c5-af732e2afe27', '27eae553-9539-4a42-a282-2e1c43b433ea', '67ddc2d0-0f1a-44fb-867d-8ecb42a150b2', '34805e48-cf22-407f-a7e1-e1ba5308394d'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:26 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b" returned: 0 in 0.697s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:26 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b Jul 28 16:35:26 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:26 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:26 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:27 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.333s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:27 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:27 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Deleted volume successfully. Jul 28 16:35:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a4ccf75d-6773-406f-aaee-8c0a9b5641ea tempest-AttachVolumeTestJSON-200322447 None] Lock "cinder-30a50bed-4a45-49de-b942-73975c03fd39-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:34 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" returned: 0 in 7.447s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b60d360-54c4-4bfb-87b5-de160835f58d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:34 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b Jul 28 16:35:34 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:34 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b" returned: 0 in 0.568s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:35:34 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Converted 1024.00 MB image at 137.48 MB/s Jul 28 16:35:34 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b is being set with open permissions: ugo+rw Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:34 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b Jul 28 16:35:34 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:34 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" returned: 0 in 0.251s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" released by "_copy_volume_from_snapshot" :: held 10.062s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-a6a12565-9228-47a2-bbc7-2bd1baadaf9d-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" released by "_create_volume_from_snapshot" :: held 10.108s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.129s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:35 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=90,cinder:UPDATE=115,cinder:INSERT=23,cinder:DELETE=10 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:35:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905b4df8-1f63-4950-9665-533c18cf9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b', 'volume_size': 1, 'snapshot_id': 'a6a12565-9228-47a2-bbc7-2bd1baadaf9d'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a1c57-4541-485c-8b71-856c8fcac272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:35 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Volume volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b (4f015bf0-ef3b-4531-ad6d-3fac54d43a9b): created successfully Jul 28 16:35:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a1c57-4541-485c-8b71-856c8fcac272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Flow 'volume_create_manager' (bea0750e-751e-4071-aa84-4f241de107a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4b6af070-120a-44b3-93ea-7be910bb8280 tempest-VolumeDependencyTests-634914822 None] Created volume successfully. Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-a6a12565-9228-47a2-bbc7-2bd1baadaf9d-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-a6a12565-9228-47a2-bbc7-2bd1baadaf9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-quobyte-4e032721-8da5-43d8-b9b0-5a5305b8b25b" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4e032721-8da5-43d8-b9b0-5a5305b8b25b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-quobyte-a6a12565-9228-47a2-bbc7-2bd1baadaf9d" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-a6a12565-9228-47a2-bbc7-2bd1baadaf9d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Deleting offline snapshot a6a12565-9228-47a2-bbc7-2bd1baadaf9d of volume 4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] snapshot_file for this snap is: volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ec6a7-06b7-4407-bfb7-fb2bb57e457b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:36 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d Jul 28 16:35:36 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:37 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d" returned: 0 in 0.449s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:35:37 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a1660a-dff1-4793-bcf8-f6a780264e38]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:37 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b Jul 28 16:35:37 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:37 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b" returned: 0 in 0.544s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:37 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d Jul 28 16:35:37 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:38 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d" returned: 0 in 0.525s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:38 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d Jul 28 16:35:38 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:38 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b.a6a12565-9228-47a2-bbc7-2bd1baadaf9d" returned: 0 in 0.339s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=88,cinder:UPDATE=89,cinder:DELETE=9,cinder:INSERT=20 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-a6a12565-9228-47a2-bbc7-2bd1baadaf9d" released by "_delete_snapshot" :: held 1.993s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4e032721-8da5-43d8-b9b0-5a5305b8b25b" released by "delete_snapshot" :: held 2.026s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Created reservations ['f3b17cb2-03ac-492f-9918-5b9301d12008', '3b2d28b5-4022-4bdf-ae39-2c65bfd46817', '1614ffb9-632d-47e4-bdd9-1c93c331ad52', '52519651-fc8f-4dec-8395-2733a08d74f8'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:38 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Delete snapshot completed successfully. Jul 28 16:35:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e39a6c8f-49fe-4ec4-a0ae-c7ce5c4a58f3 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-a6a12565-9228-47a2-bbc7-2bd1baadaf9d-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-4e032721-8da5-43d8-b9b0-5a5305b8b25b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Lock "cinder-4e032721-8da5-43d8-b9b0-5a5305b8b25b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-quobyte-4e032721-8da5-43d8-b9b0-5a5305b8b25b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4e032721-8da5-43d8-b9b0-5a5305b8b25b" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92b8202-82fd-415d-a45c-a71b2f547d10]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:40 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b Jul 28 16:35:40 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:40 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b" returned: 0 in 0.477s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:40 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b Jul 28 16:35:40 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:40 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4e032721-8da5-43d8-b9b0-5a5305b8b25b" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4e032721-8da5-43d8-b9b0-5a5305b8b25b" released by "delete_volume" :: held 0.838s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Created reservations ['cde7e9e8-a7c6-4577-a51e-3ab4f87fff48', 'd1c06afa-5765-4d40-8fdb-0465d06476a1', '5b0d7281-4e2c-4b7b-8bcf-f648af0445d2', '916db823-fca4-4e9a-9e98-dcafec68f1c1'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:41 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:41 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:41 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:41 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "cinder-quobyte-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf42cf5-a26b-496b-9c66-b3aabe1a2e79]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:41 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.353s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:41 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Deleted volume successfully. Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f3e05948-5efe-4d16-aa93-3aef4e7c146a tempest-VolumeDependencyTests-634914822 None] Lock "cinder-4e032721-8da5-43d8-b9b0-5a5305b8b25b-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:41 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b Jul 28 16:35:41 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:41 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.355s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:35:41 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" returned: 0 in 0.493s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:41 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b Jul 28 16:35:41 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:42 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" returned: 0 in 0.362s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-quobyte-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b" released by "delete_volume" :: held 0.943s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Created reservations ['af595cfd-74e8-41ee-a3c2-8221cf7c0331', '087d786a-9d8c-4fa6-b15f-4b9ed022d5de', 'e3e65c94-6650-4df2-975e-e174288c9058', '5d08baba-68d5-4c4b-9453-8aaffd384827'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:42 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:42 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:42 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.424s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Deleted volume successfully. Jul 28 16:35:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1ffb321c-2a34-4137-a5ed-ffd30bbf5431 tempest-VolumeDependencyTests-634914822 None] Lock "cinder-4f015bf0-ef3b-4531-ad6d-3fac54d43a9b-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Flow 'volume_create_manager' (4f1178f0-d51b-48a9-ab74-5c40c32af3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e78005-b751-4d14-b639-ee80b0adc2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e78005-b751-4d14-b639-ee80b0adc2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-949744785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bb01c2-03d3-4194-a5e7-2307e614cff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414b5a59c3944f59016d21791ef7bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:44Z,use_quota=True,user_id='3149ee27a41747959ff0f221e436977e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10439592-71e4-43dd-bbc0-8ea020efb404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10439592-71e4-43dd-bbc0-8ea020efb404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de4e3bc-4d68-4cb2-9185-2f901209d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de4e3bc-4d68-4cb2-9185-2f901209d49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82bb01c2-03d3-4194-a5e7-2307e614cff0', 'volume_name': 'volume-82bb01c2-03d3-4194-a5e7-2307e614cff0', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc5e2de-c65f-46bf-abe7-8eb5b9f23226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc5e2de-c65f-46bf-abe7-8eb5b9f23226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd2038c-5f44-4470-8030-830a51e7916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:43 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Volume 82bb01c2-03d3-4194-a5e7-2307e614cff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82bb01c2-03d3-4194-a5e7-2307e614cff0', 'volume_size': 1} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-949744785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bb01c2-03d3-4194-a5e7-2307e614cff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414b5a59c3944f59016d21791ef7bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:44Z,use_quota=True,user_id='3149ee27a41747959ff0f221e436977e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Creating volume 82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:35:43 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:35:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:44 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 1073741824 Jul 28 16:35:44 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:44 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 1073741824" returned: 0 in 0.540s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:44 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 Jul 28 16:35:44 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:44 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd2038c-5f44-4470-8030-830a51e7916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bb01c2-03d3-4194-a5e7-2307e614cff0', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5695095d-8be4-4f8b-912a-e7239ab3166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Volume volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 (82bb01c2-03d3-4194-a5e7-2307e614cff0): created successfully Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5695095d-8be4-4f8b-912a-e7239ab3166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Flow 'volume_create_manager' (4f1178f0-d51b-48a9-ab74-5c40c32af3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-ee29c79d-3351-4924-b26c-eef4bd57decc req-f0048208-5423-4a2e-86ba-bd95cacadf6b tempest-VolumesSnapshotsTestJSON-1824259112 None] Created volume successfully. Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Creating offline snapshot 14f62294-fa1d-42e0-af7b-f5442a80a833 of volume 82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-1942ce25-9cdb-48f0-b5d9-5ba040985ad2 req-eb9706e4-ac4d-4773-be86-f87352a6b408 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d73f8d-15ae-4780-a8f8-a7837769f285]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:46 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 Jul 28 16:35:46 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:46 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0" returned: 0 in 0.411s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:46 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 1G Jul 28 16:35:46 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:47 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 1G" returned: 0 in 0.552s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:47 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 Jul 28 16:35:47 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:47 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:47 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 is being set with open permissions: ugo+rw Jul 28 16:35:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:47 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 Jul 28 16:35:48 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Flow 'volume_create_manager' (df959ee7-e96b-43f6-be5b-82b0658acde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:48 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faefa9c-7a62-4fdf-a35a-e58eae3fa00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833" returned: 0 in 0.462s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faefa9c-7a62-4fdf-a35a-e58eae3fa00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211122486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9048b944-53f4-45dd-9d41-8b4e6332e372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b262d666484b6ab63ea8eb46fae628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:48Z,use_quota=True,user_id='79ac1309c6314277abb10a45a78ab4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa43992-d439-4659-be0a-607ebf11bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa43992-d439-4659-be0a-607ebf11bc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3952c853-5ccb-48bb-a658-1be08d3ba0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3952c853-5ccb-48bb-a658-1be08d3ba0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9048b944-53f4-45dd-9d41-8b4e6332e372', 'volume_name': 'volume-9048b944-53f4-45dd-9d41-8b4e6332e372', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d080c3b-f703-4ac4-9131-cdceb0558558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d080c3b-f703-4ac4-9131-cdceb0558558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a3f87b-e5b6-410a-a8dc-aec686868a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:48 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Volume 9048b944-53f4-45dd-9d41-8b4e6332e372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9048b944-53f4-45dd-9d41-8b4e6332e372', 'volume_size': 1} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:48 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.info Jul 28 16:35:48 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:48 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.info" returned: 0 in 0.283s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:48 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.info is being set with open permissions: ugo+rw Jul 28 16:35:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:48 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.info Jul 28 16:35:48 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:49 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.info" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-1942ce25-9cdb-48f0-b5d9-5ba040985ad2 req-eb9706e4-ac4d-4773-be86-f87352a6b408 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.605s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-1942ce25-9cdb-48f0-b5d9-5ba040985ad2 req-eb9706e4-ac4d-4773-be86-f87352a6b408 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211122486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9048b944-53f4-45dd-9d41-8b4e6332e372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b262d666484b6ab63ea8eb46fae628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:48Z,use_quota=True,user_id='79ac1309c6314277abb10a45a78ab4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Creating volume 9048b944-53f4-45dd-9d41-8b4e6332e372 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:35:49 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-60753bc4-74ad-4f8a-963c-df49a6c2ec4f req-cac6180c-5c50-4a45-a895-7ad42235101d tempest-VolumesSnapshotsTestJSON-1824259112 None] Create snapshot completed successfully Jul 28 16:35:49 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 1073741824 Jul 28 16:35:49 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-1942ce25-9cdb-48f0-b5d9-5ba040985ad2 req-eb9706e4-ac4d-4773-be86-f87352a6b408 tempest-TestServerVolumeAttachmentScenario-735847450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bedc588-56ad-4e6f-9a80-a1c3b7a45d39', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:35:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-1942ce25-9cdb-48f0-b5d9-5ba040985ad2 req-eb9706e4-ac4d-4773-be86-f87352a6b408 tempest-TestServerVolumeAttachmentScenario-735847450 None] attachment_update completed successfully. Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "cinder-14f62294-fa1d-42e0-af7b-f5442a80a833-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-14f62294-fa1d-42e0-af7b-f5442a80a833-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "cinder-quobyte-82bb01c2-03d3-4194-a5e7-2307e614cff0" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-quobyte-82bb01c2-03d3-4194-a5e7-2307e614cff0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "cinder-quobyte-14f62294-fa1d-42e0-af7b-f5442a80a833" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-quobyte-14f62294-fa1d-42e0-af7b-f5442a80a833" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Deleting offline snapshot 14f62294-fa1d-42e0-af7b-f5442a80a833 of volume 82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] snapshot_file for this snap is: volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86217d2-f904-4966-b978-06f9e0df5117]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:49 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 Jul 28 16:35:49 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:49 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 1073741824" returned: 0 in 0.626s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:49 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 Jul 28 16:35:49 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:50 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833" returned: 0 in 0.491s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82bb01c2-03d3-4194-a5e7-2307e614cff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[59089e6c-c075-4887-b912-28f246f9045a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:50 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372" returned: 0 in 0.310s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a3f87b-e5b6-410a-a8dc-aec686868a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9048b944-53f4-45dd-9d41-8b4e6332e372', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9ee085-7e30-4271-87ec-02742275d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Volume volume-9048b944-53f4-45dd-9d41-8b4e6332e372 (9048b944-53f4-45dd-9d41-8b4e6332e372): created successfully Jul 28 16:35:50 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 Jul 28 16:35:50 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9ee085-7e30-4271-87ec-02742275d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Flow 'volume_create_manager' (df959ee7-e96b-43f6-be5b-82b0658acde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2269b500-e5fa-4425-a4f8-56f84a25fb07 tempest-ProjectReaderTests-491650711 None] Created volume successfully. Jul 28 16:35:50 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0" returned: 0 in 0.539s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Acquiring lock "cinder-9048b944-53f4-45dd-9d41-8b4e6332e372-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:50 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 Jul 28 16:35:50 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Lock "cinder-9048b944-53f4-45dd-9d41-8b4e6332e372-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Acquiring lock "cinder-quobyte-9048b944-53f4-45dd-9d41-8b4e6332e372" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Lock "cinder-quobyte-9048b944-53f4-45dd-9d41-8b4e6332e372" acquired by "delete_volume" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa8bd6-88ce-47c4-bd77-8a3ec0582eee]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:50 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 Jul 28 16:35:50 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:51 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:51 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833 Jul 28 16:35:51 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:51 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372" returned: 0 in 0.457s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:51 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372 Jul 28 16:35:51 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:51 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0.14f62294-fa1d-42e0-af7b-f5442a80a833" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-quobyte-14f62294-fa1d-42e0-af7b-f5442a80a833" released by "_delete_snapshot" :: held 1.973s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-quobyte-82bb01c2-03d3-4194-a5e7-2307e614cff0" released by "delete_snapshot" :: held 2.018s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:51 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9048b944-53f4-45dd-9d41-8b4e6332e372" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Lock "cinder-quobyte-9048b944-53f4-45dd-9d41-8b4e6332e372" released by "delete_volume" :: held 0.844s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.quota [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Created reservations ['812f184b-93a5-4605-a5da-af80724b8ce8', 'f982f34e-6458-48ae-aba2-ab951a041da7', '836d6b9a-2ea3-4ccb-ae82-fa4a6c3d505d', '217e0c52-d7ca-487b-84c3-d98fa3153896'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Created reservations ['4089a720-f30d-43a0-91f9-6ee01683590b', '6d45a860-c144-4436-9c2c-f2b25a8d1822', '3cee1c68-4e38-4b23-87a4-47db14c72655', '11b3f816-1d9a-4548-85ec-2765afef8b6e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Delete snapshot completed successfully. Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-65e3e838-4ea3-46fa-aa31-8829e81766ee req-00bed341-b364-41e2-b347-4f58ff06036d tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-14f62294-fa1d-42e0-af7b-f5442a80a833-delete_snapshot" released by "delete_snapshot" :: held 2.321s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "cinder-82bb01c2-03d3-4194-a5e7-2307e614cff0-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:51 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:51 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-82bb01c2-03d3-4194-a5e7-2307e614cff0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "cinder-quobyte-82bb01c2-03d3-4194-a5e7-2307e614cff0" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-quobyte-82bb01c2-03d3-4194-a5e7-2307e614cff0" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd12fb8-045a-4dfe-9395-5ceaece32e62]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.382s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:52 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 Jul 28 16:35:52 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:52 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Deleted volume successfully. Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a478e81e-2415-4b4c-a182-1c3c70b044d4 tempest-ProjectReaderTests-491650711 None] Lock "cinder-9048b944-53f4-45dd-9d41-8b4e6332e372-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:52 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0" returned: 0 in 0.542s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:52 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0 Jul 28 16:35:52 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Flow 'volume_create_manager' (666cb74a-ab92-4ce8-b1f5-900785f41d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3986fd27-bff9-4396-89c8-bcbcc7b0bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3986fd27-bff9-4396-89c8-bcbcc7b0bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996904272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5902889a-d0f7-40e6-a120-0db6f31b4a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b262d666484b6ab63ea8eb46fae628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:53Z,use_quota=True,user_id='79ac1309c6314277abb10a45a78ab4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57582f6-d359-4230-a12d-8d6d2af810cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57582f6-d359-4230-a12d-8d6d2af810cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3028dc-7939-4a7d-a858-cabd8f782062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3028dc-7939-4a7d-a858-cabd8f782062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5902889a-d0f7-40e6-a120-0db6f31b4a96', 'volume_name': 'volume-5902889a-d0f7-40e6-a120-0db6f31b4a96', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70af597-320f-42af-aade-2c79f1116df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70af597-320f-42af-aade-2c79f1116df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128eee0c-52a4-4471-a26c-6a3da7cf9f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Volume 5902889a-d0f7-40e6-a120-0db6f31b4a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5902889a-d0f7-40e6-a120-0db6f31b4a96', 'volume_size': 1} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996904272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5902889a-d0f7-40e6-a120-0db6f31b4a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b262d666484b6ab63ea8eb46fae628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:35:53Z,use_quota=True,user_id='79ac1309c6314277abb10a45a78ab4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Creating volume 5902889a-d0f7-40e6-a120-0db6f31b4a96 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:35:52 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:52 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 1073741824 Jul 28 16:35:52 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:52 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-82bb01c2-03d3-4194-a5e7-2307e614cff0" returned: 0 in 0.330s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-quobyte-82bb01c2-03d3-4194-a5e7-2307e614cff0" released by "delete_volume" :: held 0.979s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.quota [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Created reservations ['9ff93dd5-6ff2-42f0-9d1d-6a62a6038a6f', 'd98cb49c-bceb-4f15-b3a0-981eb9d226ad', '2902557e-2d4b-4293-aada-24e373089eb1', '015d3a90-58b4-49b1-bf36-1bda559eb029'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:53 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:53 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:53 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 1073741824" returned: 0 in 0.590s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:53 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.312s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.manager [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Deleted volume successfully. Jul 28 16:35:53 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 Jul 28 16:35:53 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-ebe89299-6478-4644-a346-e389b7fcef6d req-7d83a59a-6596-4a58-82c4-1a178adcc098 tempest-VolumesSnapshotsTestJSON-1824259112 None] Lock "cinder-82bb01c2-03d3-4194-a5e7-2307e614cff0-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:53 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128eee0c-52a4-4471-a26c-6a3da7cf9f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5902889a-d0f7-40e6-a120-0db6f31b4a96', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aad6267-3c8a-4f08-bcdb-98a4790275cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:35:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Volume volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 (5902889a-d0f7-40e6-a120-0db6f31b4a96): created successfully Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aad6267-3c8a-4f08-bcdb-98a4790275cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:35:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Flow 'volume_create_manager' (666cb74a-ab92-4ce8-b1f5-900785f41d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:35:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d6b3102a-8576-4bea-85d2-6a961fb959ad tempest-ProjectReaderTests-491650711 None] Created volume successfully. Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-a600d36f-73c2-4e3b-bc27-0f14e2c17a3f req-9dce0baa-b8dd-412c-89d2-1207482153e5 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-a600d36f-73c2-4e3b-bc27-0f14e2c17a3f req-9dce0baa-b8dd-412c-89d2-1207482153e5 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-a600d36f-73c2-4e3b-bc27-0f14e2c17a3f req-9dce0baa-b8dd-412c-89d2-1207482153e5 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-a600d36f-73c2-4e3b-bc27-0f14e2c17a3f req-9dce0baa-b8dd-412c-89d2-1207482153e5 tempest-TestServerVolumeAttachmentScenario-735847450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d08ff6d-c6cc-4e70-83dc-71109091ec08', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:35:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-a600d36f-73c2-4e3b-bc27-0f14e2c17a3f req-9dce0baa-b8dd-412c-89d2-1207482153e5 tempest-TestServerVolumeAttachmentScenario-735847450 None] attachment_update completed successfully. Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Acquiring lock "cinder-5902889a-d0f7-40e6-a120-0db6f31b4a96-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Lock "cinder-5902889a-d0f7-40e6-a120-0db6f31b4a96-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Acquiring lock "cinder-quobyte-5902889a-d0f7-40e6-a120-0db6f31b4a96" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Lock "cinder-quobyte-5902889a-d0f7-40e6-a120-0db6f31b4a96" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4a752e-dcca-4c83-952d-dc4c32f83d00]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:35:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:55 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 Jul 28 16:35:55 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:55 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96" returned: 0 in 0.564s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:55 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96 Jul 28 16:35:55 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:55 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5902889a-d0f7-40e6-a120-0db6f31b4a96" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Lock "cinder-quobyte-5902889a-d0f7-40e6-a120-0db6f31b4a96" released by "delete_volume" :: held 0.950s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:55 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Created reservations ['d4c42d49-81e3-4586-9396-6984c8b9f825', 'c168e09d-872e-45e9-b6b1-7e18b20b32c0', 'ce0e504a-8561-4e3e-9f28-bcf9237acec2', '5edde604-46e2-4269-ae0e-2dce664aa4e6'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:35:56 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:35:56 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:35:56 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.336s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:35:56 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Deleted volume successfully. Jul 28 16:35:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9fe78afb-59d2-4aca-9ac4-ea93537888ff tempest-ProjectReaderTests-491650711 None] Lock "cinder-5902889a-d0f7-40e6-a120-0db6f31b4a96-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:35:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-823e9767-fd85-40f7-947c-39dcaa2f760d req-1ba24633-b1b0-45eb-8d37-95f02c885d93 tempest-TestServerVolumeAttachmentScenario-735847450 None] Terminate volume connection completed successfully. Jul 28 16:35:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-823e9767-fd85-40f7-947c-39dcaa2f760d req-1ba24633-b1b0-45eb-8d37-95f02c885d93 tempest-TestServerVolumeAttachmentScenario-735847450 None] Deleting attachment 6d08ff6d-c6cc-4e70-83dc-71109091ec08. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:35:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-812808ea-e6e3-4f01-9cab-288a6f91e3c0 req-791cf461-9743-44f4-9367-c112472d1725 tempest-TestServerVolumeAttachmentScenario-735847450 None] Terminate volume connection completed successfully. Jul 28 16:35:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-812808ea-e6e3-4f01-9cab-288a6f91e3c0 req-791cf461-9743-44f4-9367-c112472d1725 tempest-TestServerVolumeAttachmentScenario-735847450 None] Deleting attachment 1bedc588-56ad-4e6f-9a80-a1c3b7a45d39. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:36:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-d38a626a-c3d8-4982-bef4-f3729e98b36a tempest-TestShelveInstance-661069423 None] Terminate volume connection completed successfully. Jul 28 16:36:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-d38a626a-c3d8-4982-bef4-f3729e98b36a tempest-TestShelveInstance-661069423 None] Deleting attachment 4b48d579-a543-4bd5-8ee1-983c7ef40bac. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:36:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Acquiring lock "cinder-053d3f14-dd9a-4149-b71c-7d9c22832891-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Lock "cinder-053d3f14-dd9a-4149-b71c-7d9c22832891-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Acquiring lock "cinder-quobyte-053d3f14-dd9a-4149-b71c-7d9c22832891" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Lock "cinder-quobyte-053d3f14-dd9a-4149-b71c-7d9c22832891" acquired by "delete_volume" :: waited 0.034s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8563fd-1307-489a-9f0b-6ed759aa42a6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:02 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 Jul 28 16:36:02 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:02 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891" returned: 0 in 0.803s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:02 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891 Jul 28 16:36:02 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:03 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-053d3f14-dd9a-4149-b71c-7d9c22832891" returned: 0 in 0.404s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Lock "cinder-quobyte-053d3f14-dd9a-4149-b71c-7d9c22832891" released by "delete_volume" :: held 1.312s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG cinder.quota [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Created reservations ['99b95211-1254-445d-af2b-82b21dbfe4b2', 'd1bc5b83-420d-4991-a4aa-5ce381b46f3b', '03096d1a-f9b4-46a5-b09f-0407800a710f', '458537f3-120b-49ea-af42-65bd4b9f7403'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:03 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:03 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:04 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.642s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:04 devstack cinder-volume[88286]: DEBUG cinder.manager [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:04 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Deleted volume successfully. Jul 28 16:36:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [req-c154ab53-5e68-4c3b-8b95-2d3cd2c4d6f9 req-746d61e4-4901-4cf3-83bf-d862d10d8f05 tempest-TestShelveInstance-661069423 None] Lock "cinder-053d3f14-dd9a-4149-b71c-7d9c22832891-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "cinder-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "cinder-quobyte-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-quobyte-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[468a7232-160e-476e-a902-33e9e17df878]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:08 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 Jul 28 16:36:08 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:08 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98" returned: 0 in 0.588s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:08 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98 Jul 28 16:36:08 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:08 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98" returned: 0 in 0.401s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-quobyte-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98" released by "delete_volume" :: held 1.077s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Created reservations ['39f196a3-c784-41ce-94df-5c7d7f4c740d', '6a7f2ce6-c29e-4fa5-85e5-a25b977f854a', '6d9fb2e0-dfc9-4beb-80ec-615b730f4917', 'e6eddceb-ecf2-42ea-b77b-0d89f80ae362'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:09 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:09 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:09 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.443s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Deleted volume successfully. Jul 28 16:36:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-659a1229-8ace-41fc-be6e-63c17cbef5c1 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-3836bde7-0a76-4cfe-a3fc-d9e8755c6c98-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "cinder-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "cinder-quobyte-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-quobyte-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc466d-9736-441f-97c1-bbcee3183476]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:10 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 Jul 28 16:36:10 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:10 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21" returned: 0 in 0.433s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:10 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21 Jul 28 16:36:10 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-df46f6d1-6f9f-4667-979e-017fccdce7f1 tempest-GroupsTest-491137244 None] Group tempest-Group1-1646169792: creating Jul 28 16:36:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-df46f6d1-6f9f-4667-979e-017fccdce7f1 tempest-GroupsTest-491137244 None] Group tempest-Group1-1646169792: created successfully Jul 28 16:36:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-df46f6d1-6f9f-4667-979e-017fccdce7f1 tempest-GroupsTest-491137244 None] Create group completed successfully. Jul 28 16:36:11 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21" returned: 0 in 0.356s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-quobyte-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21" released by "delete_volume" :: held 0.847s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Created reservations ['e5374abc-ce61-4893-93cf-822933f2d752', '896668a2-c08e-4272-87d4-9db823dc7d2d', 'edc3be9f-c7a7-4398-8f68-dd5d41ae213c', 'd7f52499-19ff-4623-b000-67f3d550b82a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:11 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:11 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:11 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.288s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Deleted volume successfully. Jul 28 16:36:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-50f92760-5283-4e2e-9f61-a3ad0cded309 tempest-TestServerVolumeAttachmentScenario-735847450 None] Lock "cinder-ccc9bfd6-cd7e-4209-9e86-ec4a849c7b21-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3cb14505-33f0-46e7-bf40-641acb517762 tempest-GroupsTest-491137244 None] Group tempest-Group2-639506706: creating Jul 28 16:36:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3cb14505-33f0-46e7-bf40-641acb517762 tempest-GroupsTest-491137244 None] Group tempest-Group2-639506706: created successfully Jul 28 16:36:12 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3cb14505-33f0-46e7-bf40-641acb517762 tempest-GroupsTest-491137244 None] Create group completed successfully. Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Flow 'volume_create_manager' (98c91e6f-93ef-4d2f-b48b-7de04f5fe0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4616570-2469-449d-a097-b2507f190b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4616570-2469-449d-a097-b2507f190b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519118260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60280b9e-92ab-4139-8468-8d9a2db3717b,host='devstack@QuobyteHD#QuobyteHD',id=56d78c14-7507-4630-92c7-b44af05a7d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482f898b49a14133945727d32dd045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:14Z,use_quota=True,user_id='337c2f0a6cc94c2a8a261c596431dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d2ad84d-3095-47c2-af63-bfb2c49df8a9),volume_type_id=7d2ad84d-3095-47c2-af63-bfb2c49df8a9)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c327161b-d77d-46e0-a935-cd8393bd898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c327161b-d77d-46e0-a935-cd8393bd898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc34d68b-cbcc-49c7-8f36-58fe4d7187f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc34d68b-cbcc-49c7-8f36-58fe4d7187f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d78c14-7507-4630-92c7-b44af05a7d0a', 'volume_name': 'volume-56d78c14-7507-4630-92c7-b44af05a7d0a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24284c12-f6bc-4df9-97ba-5f633441306a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24284c12-f6bc-4df9-97ba-5f633441306a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f33277-d0d3-4d5c-bf0c-afe56838765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:14 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Volume 56d78c14-7507-4630-92c7-b44af05a7d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d78c14-7507-4630-92c7-b44af05a7d0a', 'volume_size': 1} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60280b9e-92ab-4139-8468-8d9a2db3717b,created_at=2026-07-28T14:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519118260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60280b9e-92ab-4139-8468-8d9a2db3717b,host='devstack@QuobyteHD#QuobyteHD',id=56d78c14-7507-4630-92c7-b44af05a7d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482f898b49a14133945727d32dd045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:14Z,use_quota=True,user_id='337c2f0a6cc94c2a8a261c596431dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d2ad84d-3095-47c2-af63-bfb2c49df8a9),volume_type_id=7d2ad84d-3095-47c2-af63-bfb2c49df8a9)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Creating volume 56d78c14-7507-4630-92c7-b44af05a7d0a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:14 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:14 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a 1073741824 Jul 28 16:36:14 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:15 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a 1073741824" returned: 0 in 0.637s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:15 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a Jul 28 16:36:15 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:15 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a" returned: 0 in 0.310s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f33277-d0d3-4d5c-bf0c-afe56838765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d78c14-7507-4630-92c7-b44af05a7d0a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44985965-4140-4dad-9eb8-29c71a108b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Volume volume-56d78c14-7507-4630-92c7-b44af05a7d0a (56d78c14-7507-4630-92c7-b44af05a7d0a): created successfully Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44985965-4140-4dad-9eb8-29c71a108b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Flow 'volume_create_manager' (98c91e6f-93ef-4d2f-b48b-7de04f5fe0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:15 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-30091ab7-5491-4977-b06e-d6ee0e0faad1 tempest-GroupsTest-491137244 None] Created volume successfully. Jul 28 16:36:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Acquiring lock "cinder-quobyte-56d78c14-7507-4630-92c7-b44af05a7d0a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Lock "cinder-quobyte-56d78c14-7507-4630-92c7-b44af05a7d0a" acquired by "delete_volume" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b63d08c-3c5c-43e6-91cc-a2c8e7f6340c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:17 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a Jul 28 16:36:17 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:18 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:18 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a Jul 28 16:36:18 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:18 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-56d78c14-7507-4630-92c7-b44af05a7d0a" returned: 0 in 0.296s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Lock "cinder-quobyte-56d78c14-7507-4630-92c7-b44af05a7d0a" released by "delete_volume" :: held 0.830s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Created reservations ['25c97967-80dc-4667-994d-b82fd8e77b2d'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:18 devstack cinder-volume[88286]: WARNING cinder.quota [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2057106767 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2057106767, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:36:18 devstack cinder-volume[88286]: WARNING cinder.quota [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2057106767 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2057106767, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Created reservations ['fcdad159-c3f0-4169-90ae-29d59092ed44', '157ac2e5-c026-42df-826a-86e7e3026a38', '6d199e9d-92fd-4de8-ae2d-f541cf4b2e45', 'f7a7a82f-5c78-47a2-9377-8ad9b73b40a0'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:18 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:18 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Created reservations ['3997fc3b-e26a-4b91-9e30-704e2286ce3b'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:19 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.379s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:19 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ef84fee6-04a4-4a03-8a66-445f0257d68d tempest-GroupsTest-491137244 None] Delete group completed successfully. Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:19 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:19 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:19 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.302s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:19 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:19 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8de4d9c6-e3e1-43e8-96ba-16c710bebd02 tempest-GroupsTest-491137244 None] Delete group completed successfully. Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (8fec87da-7b75-484d-b7e4-7e2da017201d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc7d0d8-c83e-44fe-84a9-86abf2e3e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc7d0d8-c83e-44fe-84a9-86abf2e3e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620593538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cddca97-f9c1-46ed-8a2c-9db42d2ac451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:20Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae44b2c-2a2a-4757-9cee-853af00f7371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae44b2c-2a2a-4757-9cee-853af00f7371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c21762-b7b2-4bf7-b56a-a263924485c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c21762-b7b2-4bf7-b56a-a263924485c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cddca97-f9c1-46ed-8a2c-9db42d2ac451', 'volume_name': 'volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf78543-f5fa-47a7-b26e-783b8794e78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf78543-f5fa-47a7-b26e-783b8794e78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1caa15-774f-49a0-82fe-daccc241bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:20 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume 6cddca97-f9c1-46ed-8a2c-9db42d2ac451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451', 'volume_size': 1} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620593538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cddca97-f9c1-46ed-8a2c-9db42d2ac451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:20Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Creating volume 6cddca97-f9c1-46ed-8a2c-9db42d2ac451 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:20 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:20 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 1073741824 Jul 28 16:36:20 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:20 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 1073741824" returned: 0 in 0.665s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-00d3621e-757a-43aa-9fbc-b33b3cc058c7 tempest-GroupsTest-491137244 None] Group tempest-GroupsTest-Group-703064455: creating Jul 28 16:36:21 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 Jul 28 16:36:21 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-00d3621e-757a-43aa-9fbc-b33b3cc058c7 tempest-GroupsTest-491137244 None] Group tempest-GroupsTest-Group-703064455: created successfully Jul 28 16:36:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-00d3621e-757a-43aa-9fbc-b33b3cc058c7 tempest-GroupsTest-491137244 None] Create group completed successfully. Jul 28 16:36:21 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1caa15-774f-49a0-82fe-daccc241bde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2141cbfc-16f3-4574-9738-8f9bdcbc3ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:21 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 (6cddca97-f9c1-46ed-8a2c-9db42d2ac451): created successfully Jul 28 16:36:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2141cbfc-16f3-4574-9738-8f9bdcbc3ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (8fec87da-7b75-484d-b7e4-7e2da017201d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e2de14b7-1fc8-43bc-868d-5832782b4266 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created volume successfully. Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Flow 'volume_create_manager' (e403c6b2-5d79-48f0-bfaa-ee9973fcacd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08bd90d-b613-4ca3-9562-c116530720d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08bd90d-b613-4ca3-9562-c116530720d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468718737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b85a9d-a7b5-4702-86b8-b6efb60bdae5,host='devstack@QuobyteHD#QuobyteHD',id=0d7ee462-2e21-46ad-a92d-8aa61d74c02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482f898b49a14133945727d32dd045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:23Z,use_quota=True,user_id='337c2f0a6cc94c2a8a261c596431dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2401606c-e2d9-4f82-8bec-4d2ccbe03049),volume_type_id=2401606c-e2d9-4f82-8bec-4d2ccbe03049)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59bbb02-8507-47bf-9a6f-aa3a763e6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59bbb02-8507-47bf-9a6f-aa3a763e6aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b495a850-3784-44e1-993e-efc225684db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b495a850-3784-44e1-993e-efc225684db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7ee462-2e21-46ad-a92d-8aa61d74c02c', 'volume_name': 'volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c02f6-f48b-4eeb-908c-94b5013383c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c02f6-f48b-4eeb-908c-94b5013383c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81b88e3-6266-4535-8956-2690d6070dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:22 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Volume 0d7ee462-2e21-46ad-a92d-8aa61d74c02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c', 'volume_size': 1} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8b85a9d-a7b5-4702-86b8-b6efb60bdae5,created_at=2026-07-28T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468718737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b85a9d-a7b5-4702-86b8-b6efb60bdae5,host='devstack@QuobyteHD#QuobyteHD',id=0d7ee462-2e21-46ad-a92d-8aa61d74c02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482f898b49a14133945727d32dd045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:23Z,use_quota=True,user_id='337c2f0a6cc94c2a8a261c596431dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2401606c-e2d9-4f82-8bec-4d2ccbe03049),volume_type_id=2401606c-e2d9-4f82-8bec-4d2ccbe03049)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Creating volume 0d7ee462-2e21-46ad-a92d-8aa61d74c02c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:22 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:22 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c 1073741824 Jul 28 16:36:22 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:22 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (38ce7fb1-815b-4d2c-bd03-8b07123182f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12748e4d-1df2-4003-825c-90759a0dddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12748e4d-1df2-4003-825c-90759a0dddcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1333599473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9f3a58-866d-4192-af0a-fde7cb5c0c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:23Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14187372-f49c-44cb-a825-6d406fec0a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14187372-f49c-44cb-a825-6d406fec0a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eafa8c-6d38-4ae6-8030-1b18de18d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eafa8c-6d38-4ae6-8030-1b18de18d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9f3a58-866d-4192-af0a-fde7cb5c0c34', 'volume_name': 'volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a2d8b1-21b8-49f0-ac92-a5ff36675294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a2d8b1-21b8-49f0-ac92-a5ff36675294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a2be12-0c3e-44c3-a457-56b1aaf90587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume ee9f3a58-866d-4192-af0a-fde7cb5c0c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34', 'volume_size': 1} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (22a5b5d8-40ba-47dd-828c-ab57db026dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705e9c7c-556a-497d-b247-d3eccc5078eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705e9c7c-556a-497d-b247-d3eccc5078eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944414819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b439b057-2fbc-400a-b021-d0741c1316e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:23Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af34ecf1-a9ef-4ed1-ad76-757f92d107d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af34ecf1-a9ef-4ed1-ad76-757f92d107d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1cdfcc-7ced-4bbc-beb7-ff27301d3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1cdfcc-7ced-4bbc-beb7-ff27301d3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b439b057-2fbc-400a-b021-d0741c1316e1', 'volume_name': 'volume-b439b057-2fbc-400a-b021-d0741c1316e1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c016b56-d46e-4e88-b581-cf6df61202b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c016b56-d46e-4e88-b581-cf6df61202b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fded61cf-52a0-4035-8350-38925661fb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:23 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume b439b057-2fbc-400a-b021-d0741c1316e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b439b057-2fbc-400a-b021-d0741c1316e1', 'volume_size': 1} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:23 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c 1073741824" returned: 0 in 0.654s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:23 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c Jul 28 16:36:23 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:23 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1333599473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9f3a58-866d-4192-af0a-fde7cb5c0c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:23Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Creating volume ee9f3a58-866d-4192-af0a-fde7cb5c0c34 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:23 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:24 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 1073741824 Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81b88e3-6266-4535-8956-2690d6070dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d40df28-33c0-49f3-82c3-c57341b7c8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Volume volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c (0d7ee462-2e21-46ad-a92d-8aa61d74c02c): created successfully Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d40df28-33c0-49f3-82c3-c57341b7c8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Flow 'volume_create_manager' (e403c6b2-5d79-48f0-bfaa-ee9973fcacd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (a9e7adf5-52db-44b1-8604-ed2adbb0db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b327470b-9deb-4d3b-8db8-69b8c83845f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f56f0279-01d0-4183-81c2-aebd4984fbee tempest-GroupsTest-491137244 None] Created volume successfully. Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b327470b-9deb-4d3b-8db8-69b8c83845f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776944702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128ddfe0-d8f6-4c23-941b-2d5a682c188e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:24Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30083765-72b6-422e-b6cc-9b5a97e7c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30083765-72b6-422e-b6cc-9b5a97e7c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2d514f-5be3-419f-ab9e-1bbb7d5071d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2d514f-5be3-419f-ab9e-1bbb7d5071d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128ddfe0-d8f6-4c23-941b-2d5a682c188e', 'volume_name': 'volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0783c5f-aa06-4371-972f-423965ffdb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0783c5f-aa06-4371-972f-423965ffdb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1aee31-1297-4c07-982d-394e01b6dfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume 128ddfe0-d8f6-4c23-941b-2d5a682c188e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e', 'volume_size': 1} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (82b44475-cc77-4539-8184-ee4247294b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831d8d32-be63-4704-a2ea-ccec879902de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831d8d32-be63-4704-a2ea-ccec879902de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046211366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bec98dc-a5b6-4573-983b-f633da526ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:24Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d977aff-a497-47ad-b983-6fdd5eb00660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d977aff-a497-47ad-b983-6fdd5eb00660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff598d7-f7e6-4577-99e5-6785651198f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff598d7-f7e6-4577-99e5-6785651198f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bec98dc-a5b6-4573-983b-f633da526ca6', 'volume_name': 'volume-5bec98dc-a5b6-4573-983b-f633da526ca6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcb7628-ac26-4969-841f-d927c5806bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcb7628-ac26-4969-841f-d927c5806bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2fb785-0119-42e8-8c24-b2b8cbe96a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume 5bec98dc-a5b6-4573-983b-f633da526ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bec98dc-a5b6-4573-983b-f633da526ca6', 'volume_size': 1} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:24 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 1073741824" returned: 0 in 0.681s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:24 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 Jul 28 16:36:24 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (fc669ba5-97a6-42e1-a6b0-69d8495a9cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec6a309-623f-4959-9d2f-3f49b9c60c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec6a309-623f-4959-9d2f-3f49b9c60c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-87909385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12791543-91ee-491c-b4f0-e57260767b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:25Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc4bb9-3cab-43b9-b98d-543db4582110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc4bb9-3cab-43b9-b98d-543db4582110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d39f9-5caf-4ba6-a2f1-1a383addc3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d39f9-5caf-4ba6-a2f1-1a383addc3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12791543-91ee-491c-b4f0-e57260767b5c', 'volume_name': 'volume-12791543-91ee-491c-b4f0-e57260767b5c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bc1d69-ed65-4429-bd33-9359c43520dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bc1d69-ed65-4429-bd33-9359c43520dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33f8fc9-8257-423f-a19c-dd27c39045da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:24 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume 12791543-91ee-491c-b4f0-e57260767b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12791543-91ee-491c-b4f0-e57260767b5c', 'volume_size': 1} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:24 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34" returned: 0 in 0.302s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.546s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944414819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b439b057-2fbc-400a-b021-d0741c1316e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:23Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Creating volume b439b057-2fbc-400a-b021-d0741c1316e1 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:25 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a2be12-0c3e-44c3-a457-56b1aaf90587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:25 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 1073741824 Jul 28 16:36:25 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3ad435-4dce-45fb-b93c-b8af23e19ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:25 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 (ee9f3a58-866d-4192-af0a-fde7cb5c0c34): created successfully Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3ad435-4dce-45fb-b93c-b8af23e19ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (38ce7fb1-815b-4d2c-bd03-8b07123182f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-08cba82c-dd20-4a0f-9dfd-28e7c3f07bee tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created volume successfully. Jul 28 16:36:25 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 1073741824" returned: 0 in 0.593s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (19f5e9b3-7620-468c-af07-7c6a19d15b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d6ae7b-e3e6-438a-9f7e-24d82388c9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d6ae7b-e3e6-438a-9f7e-24d82388c9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1709557770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a86be6c-939f-4048-9496-2175842bc1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:26Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84ead96-1bd7-416b-863e-0addb685f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84ead96-1bd7-416b-863e-0addb685f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8400a681-794b-44bc-abd3-7f5efa807e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8400a681-794b-44bc-abd3-7f5efa807e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a86be6c-939f-4048-9496-2175842bc1b3', 'volume_name': 'volume-7a86be6c-939f-4048-9496-2175842bc1b3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431e42ab-9409-4b53-a03f-a13a9dfb3ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431e42ab-9409-4b53-a03f-a13a9dfb3ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a5d8c7-4c49-4f53-b1fb-02e6e17c4978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:25 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume 7a86be6c-939f-4048-9496-2175842bc1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a86be6c-939f-4048-9496-2175842bc1b3', 'volume_size': 1} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:25 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 Jul 28 16:36:25 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:25 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Flow 'volume_create_manager' (457ba1d9-3fbf-46f8-8a97-267893daf2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbc0644-c585-47d2-a27c-dd064591585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbc0644-c585-47d2-a27c-dd064591585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954789349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b85a9d-a7b5-4702-86b8-b6efb60bdae5,host='devstack@QuobyteHD#QuobyteHD',id=7df93876-e3e1-4dfa-a9bb-d7487f57efab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482f898b49a14133945727d32dd045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:26Z,use_quota=True,user_id='337c2f0a6cc94c2a8a261c596431dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2401606c-e2d9-4f82-8bec-4d2ccbe03049),volume_type_id=2401606c-e2d9-4f82-8bec-4d2ccbe03049)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc012a6-dbf1-47a0-8e54-53681cfa14ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc012a6-dbf1-47a0-8e54-53681cfa14ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d30323-b3b6-4c87-b409-aa432f70e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d30323-b3b6-4c87-b409-aa432f70e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df93876-e3e1-4dfa-a9bb-d7487f57efab', 'volume_name': 'volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a2f278-889c-481e-9548-0f4335d9f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a2f278-889c-481e-9548-0f4335d9f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3369bd9b-31e7-46e1-a658-fc88dcdbba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:26 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Volume 7df93876-e3e1-4dfa-a9bb-d7487f57efab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab', 'volume_size': 1} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.868s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776944702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128ddfe0-d8f6-4c23-941b-2d5a682c188e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:24Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Creating volume 128ddfe0-d8f6-4c23-941b-2d5a682c188e {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:26 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fded61cf-52a0-4035-8350-38925661fb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b439b057-2fbc-400a-b021-d0741c1316e1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e 1073741824 Jul 28 16:36:26 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afed5474-2784-4ee6-9690-c6c1fd4870ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:26 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume volume-b439b057-2fbc-400a-b021-d0741c1316e1 (b439b057-2fbc-400a-b021-d0741c1316e1): created successfully Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afed5474-2784-4ee6-9690-c6c1fd4870ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (22a5b5d8-40ba-47dd-828c-ab57db026dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-09a2eb78-558d-4923-829b-b53eb7f8996e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created volume successfully. Jul 28 16:36:26 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e 1073741824" returned: 0 in 0.455s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:26 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e Jul 28 16:36:26 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:26 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e" returned: 0 in 0.262s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.332s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046211366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bec98dc-a5b6-4573-983b-f633da526ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:24Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Creating volume 5bec98dc-a5b6-4573-983b-f633da526ca6 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:26 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1aee31-1297-4c07-982d-394e01b6dfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 1073741824 Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf859fd8-7500-4116-bc21-c8f7e0319d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:26 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:26 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e (128ddfe0-d8f6-4c23-941b-2d5a682c188e): created successfully Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf859fd8-7500-4116-bc21-c8f7e0319d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:26 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (a9e7adf5-52db-44b1-8604-ed2adbb0db20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d08c8a2d-10a0-4faf-876e-66176290fa1e tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created volume successfully. Jul 28 16:36:27 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 1073741824" returned: 0 in 0.484s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:27 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 Jul 28 16:36:27 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:27 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6" returned: 0 in 0.266s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.730s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-87909385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12791543-91ee-491c-b4f0-e57260767b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ee17ac40d428ba1c6c82c51abcba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:25Z,use_quota=True,user_id='428df589f182496f8bb8dfbb826f10a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Creating volume 12791543-91ee-491c-b4f0-e57260767b5c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:27 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:27 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c 1073741824 Jul 28 16:36:27 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2fb785-0119-42e8-8c24-b2b8cbe96a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bec98dc-a5b6-4573-983b-f633da526ca6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe08042-14ad-4bea-abf5-90194972bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:27 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume volume-5bec98dc-a5b6-4573-983b-f633da526ca6 (5bec98dc-a5b6-4573-983b-f633da526ca6): created successfully Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe08042-14ad-4bea-abf5-90194972bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (82b44475-cc77-4539-8184-ee4247294b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:27 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-441734c9-8e30-468f-95c7-a8321806e341 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created volume successfully. Jul 28 16:36:28 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c 1073741824" returned: 0 in 0.449s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:28 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c Jul 28 16:36:28 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:28 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c" returned: 0 in 0.268s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1709557770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a86be6c-939f-4048-9496-2175842bc1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:26Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Creating volume 7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:28 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33f8fc9-8257-423f-a19c-dd27c39045da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12791543-91ee-491c-b4f0-e57260767b5c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82905501-7d33-4a15-9e0c-81360e1f85b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:28 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 1073741824 Jul 28 16:36:28 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:28 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Volume volume-12791543-91ee-491c-b4f0-e57260767b5c (12791543-91ee-491c-b4f0-e57260767b5c): created successfully Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82905501-7d33-4a15-9e0c-81360e1f85b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Flow 'volume_create_manager' (fc669ba5-97a6-42e1-a6b0-69d8495a9cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-afcbc573-2aa6-4c26-bb18-7cc5b9b89116 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created volume successfully. Jul 28 16:36:28 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 1073741824" returned: 0 in 0.456s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:28 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 Jul 28 16:36:28 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:29 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3" returned: 0 in 0.264s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.108s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8b85a9d-a7b5-4702-86b8-b6efb60bdae5,created_at=2026-07-28T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954789349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b85a9d-a7b5-4702-86b8-b6efb60bdae5,host='devstack@QuobyteHD#QuobyteHD',id=7df93876-e3e1-4dfa-a9bb-d7487f57efab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482f898b49a14133945727d32dd045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:26Z,use_quota=True,user_id='337c2f0a6cc94c2a8a261c596431dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2401606c-e2d9-4f82-8bec-4d2ccbe03049),volume_type_id=2401606c-e2d9-4f82-8bec-4d2ccbe03049)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Creating volume 7df93876-e3e1-4dfa-a9bb-d7487f57efab {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:29 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a5d8c7-4c49-4f53-b1fb-02e6e17c4978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a86be6c-939f-4048-9496-2175842bc1b3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:29 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab 1073741824 Jul 28 16:36:29 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b588fe-b4e9-46c7-ae6f-362593da2399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:29 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume volume-7a86be6c-939f-4048-9496-2175842bc1b3 (7a86be6c-939f-4048-9496-2175842bc1b3): created successfully Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b588fe-b4e9-46c7-ae6f-362593da2399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (19f5e9b3-7620-468c-af07-7c6a19d15b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:29 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4b61783e-8b64-47b0-85bc-e731547de781 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created volume successfully. Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-12791543-91ee-491c-b4f0-e57260767b5c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-12791543-91ee-491c-b4f0-e57260767b5c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-quobyte-12791543-91ee-491c-b4f0-e57260767b5c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-12791543-91ee-491c-b4f0-e57260767b5c" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8644073e-89b4-4332-aa02-661118d253d8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:29 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c Jul 28 16:36:29 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:29 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab 1073741824" returned: 0 in 0.593s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:29 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab Jul 28 16:36:29 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:30 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c" returned: 0 in 0.459s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:30 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c Jul 28 16:36:30 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:30 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.109s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Creating offline snapshot 3fdb1776-5a51-4d0e-ae61-ad7faca6815e of volume 7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3369bd9b-31e7-46e1-a658-fc88dcdbba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421dd303-49a7-46d8-802f-ca4c185e6823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d397820-56a3-42e2-a896-f327c5d917f7]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:30 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Volume volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab (7df93876-e3e1-4dfa-a9bb-d7487f57efab): created successfully Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421dd303-49a7-46d8-802f-ca4c185e6823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Flow 'volume_create_manager' (457ba1d9-3fbf-46f8-8a97-267893daf2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-795a17cf-e077-4a98-9aa3-94f9aef480f1 tempest-GroupsTest-491137244 None] Created volume successfully. Jul 28 16:36:30 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-12791543-91ee-491c-b4f0-e57260767b5c" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-12791543-91ee-491c-b4f0-e57260767b5c" released by "delete_volume" :: held 0.812s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:30 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 Jul 28 16:36:30 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created reservations ['9ff60fe6-5efa-4465-bc35-80c4293ec57c', '421418cc-a112-4a1d-9a4b-b7b3b113ce4d', '391bc411-c735-441b-912d-2c86918fb0a9', 'c1e25879-bbed-4f47-a499-3b874e0ef80d'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:30 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:30 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-5bec98dc-a5b6-4573-983b-f633da526ca6-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-5bec98dc-a5b6-4573-983b-f633da526ca6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:30 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3" returned: 0 in 0.552s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-quobyte-5bec98dc-a5b6-4573-983b-f633da526ca6" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:30 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e 1G Jul 28 16:36:30 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-5bec98dc-a5b6-4573-983b-f633da526ca6" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:30 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[145edbda-01b8-4c76-a6cf-4612a2105d3a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.379s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Deleted volume successfully. Jul 28 16:36:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0b79dd15-409a-4f8e-b2f1-c57083e126c7 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-12791543-91ee-491c-b4f0-e57260767b5c-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6baabb85-e32a-4f12-847a-86abc9088fa6 tempest-GroupsTest-491137244 None] Update group completed successfully. Jul 28 16:36:30 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 Jul 28 16:36:30 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:31 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e 1G" returned: 0 in 0.535s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a86be6c-939f-4048-9496-2175842bc1b3 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:31 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6" returned: 0 in 0.469s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:31 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a86be6c-939f-4048-9496-2175842bc1b3 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e Jul 28 16:36:31 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:31 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6 Jul 28 16:36:31 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:31 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a86be6c-939f-4048-9496-2175842bc1b3 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e" returned: 0 in 0.303s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:31 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e is being set with open permissions: ugo+rw Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:31 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e Jul 28 16:36:31 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:31 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5bec98dc-a5b6-4573-983b-f633da526ca6" returned: 0 in 0.336s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-5bec98dc-a5b6-4573-983b-f633da526ca6" released by "delete_volume" :: held 0.861s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created reservations ['3b6a91cd-ad86-4503-8f81-9e1aae31e5d5', '44edb2dd-6eb1-483c-b01c-513e0a991def', '2f90b20c-4455-4f01-ba34-c8cc2f9b9e2b', '8f8fd673-3cec-4d34-8d3f-48de9a3b05c6'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-128ddfe0-d8f6-4c23-941b-2d5a682c188e-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:31 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:31 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-128ddfe0-d8f6-4c23-941b-2d5a682c188e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:31 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e" returned: 0 in 0.328s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-quobyte-128ddfe0-d8f6-4c23-941b-2d5a682c188e" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-128ddfe0-d8f6-4c23-941b-2d5a682c188e" acquired by "delete_volume" :: waited 0.048s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:32 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.info Jul 28 16:36:32 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a4b11-4963-46e7-ba78-a4a9bf43533b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:32 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.341s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:32 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e Jul 28 16:36:32 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Deleted volume successfully. Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c996caaf-8fa7-4277-b429-68d50601ffd3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-5bec98dc-a5b6-4573-983b-f633da526ca6-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:32 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.info" returned: 0 in 0.346s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:32 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.info is being set with open permissions: ugo+rw Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:32 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.info Jul 28 16:36:32 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:32 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e" returned: 0 in 0.435s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7f0fe426-6cfa-43b0-b6d2-bbdee5ee4318 tempest-GroupsTest-491137244 None] Update group completed successfully. Jul 28 16:36:32 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e Jul 28 16:36:32 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:32 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.info" returned: 0 in 0.318s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0a2602e8-3735-4ab2-86f1-5d8c08982b5b tempest-CreateVolumesFromSnapshotTest-1781621193 None] Create snapshot completed successfully Jul 28 16:36:32 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-128ddfe0-d8f6-4c23-941b-2d5a682c188e" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-128ddfe0-d8f6-4c23-941b-2d5a682c188e" released by "delete_volume" :: held 0.805s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created reservations ['ec584c3f-8ce4-414b-a67e-616de6207f67', '41625fee-cf29-498c-a8af-ae40fce94100', '119c4d73-327f-4042-bddb-c65c4057072d', '6853119f-1e36-477d-ae41-47b509eb1121'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:32 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:32 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-b439b057-2fbc-400a-b021-d0741c1316e1-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-b439b057-2fbc-400a-b021-d0741c1316e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-quobyte-b439b057-2fbc-400a-b021-d0741c1316e1" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-b439b057-2fbc-400a-b021-d0741c1316e1" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9207da-d850-4577-9cd4-ebf63b9cb511]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:33 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.335s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Deleted volume successfully. Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-87ec004e-af40-4d63-bb9b-0724592a04b6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-128ddfe0-d8f6-4c23-941b-2d5a682c188e-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:33 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 Jul 28 16:36:33 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:33 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:33 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1 Jul 28 16:36:33 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (b98dc1d7-13d0-4c7e-86ce-4583799e2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdc5eb2-6d18-4a17-b3d1-2ab9813d93a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdc5eb2-6d18-4a17-b3d1-2ab9813d93a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50318513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094e8d19-26fc-43b8-9223-3c81f6d09905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:34Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf327a8-b4f0-422f-bd4a-ec69c1d5b6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf327a8-b4f0-422f-bd4a-ec69c1d5b6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceebd63-caa7-44aa-8a96-688236cdb886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceebd63-caa7-44aa-8a96-688236cdb886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094e8d19-26fc-43b8-9223-3c81f6d09905', 'volume_name': 'volume-094e8d19-26fc-43b8-9223-3c81f6d09905', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe9d051-211f-4761-a9a8-c65d0c9f77e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe9d051-211f-4761-a9a8-c65d0c9f77e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd45e5f-716e-458a-b0a0-0c313668538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:33 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume 094e8d19-26fc-43b8-9223-3c81f6d09905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094e8d19-26fc-43b8-9223-3c81f6d09905', 'volume_size': 1} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50318513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094e8d19-26fc-43b8-9223-3c81f6d09905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:34Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Creating volume 094e8d19-26fc-43b8-9223-3c81f6d09905 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:33 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:34 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 1073741824 Jul 28 16:36:34 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:34 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-b439b057-2fbc-400a-b021-d0741c1316e1" returned: 0 in 0.495s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-b439b057-2fbc-400a-b021-d0741c1316e1" released by "delete_volume" :: held 1.049s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (f1d3e860-5e2c-4d92-8c66-42dfea57efb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1a4f41-3a5e-4ff2-926d-37b2c146b388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1a4f41-3a5e-4ff2-926d-37b2c146b388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461847043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9643a0bc-e5c2-4f74-8d96-2d384852cf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:34Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa99e1c3-89e0-485e-b612-c107e52acf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa99e1c3-89e0-485e-b612-c107e52acf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f4ec1-45f7-4cc5-85c6-e867c85c80bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f4ec1-45f7-4cc5-85c6-e867c85c80bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9643a0bc-e5c2-4f74-8d96-2d384852cf5a', 'volume_name': 'volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b400154-0251-4816-8d93-b1fcf4ccaf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b400154-0251-4816-8d93-b1fcf4ccaf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc29a86-c900-4c52-9987-fc1b92c76afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:34 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume 9643a0bc-e5c2-4f74-8d96-2d384852cf5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a', 'volume_size': 1} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Acquiring lock "cinder-quobyte-0d7ee462-2e21-46ad-a92d-8aa61d74c02c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created reservations ['b5706211-261b-4a50-83c8-da214b739688', '265ee9b7-02a5-40f5-9ab3-46b0df83a8fa', '19416581-76b2-47dc-a5d6-56add7944b39', '388292dc-9f08-4f2b-aa35-ecf166d64572'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Lock "cinder-quobyte-0d7ee462-2e21-46ad-a92d-8aa61d74c02c" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e558b5-7a97-4a00-b197-002a84ebddcc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:34 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:34 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c Jul 28 16:36:34 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 1073741824" returned: 0 in 0.871s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:34 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:34 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (74e2c3de-7456-496a-b86d-ee004e031b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297e3070-098a-4327-8f4f-fb6b2ae2860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297e3070-098a-4327-8f4f-fb6b2ae2860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122334741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:35Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faf59da-187f-4c41-a148-fcf8dbf8045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faf59da-187f-4c41-a148-fcf8dbf8045c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6dda92-43ee-4689-95e4-2bfaf9bc1448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6dda92-43ee-4689-95e4-2bfaf9bc1448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d', 'volume_name': 'volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf05bab-dd91-4545-9328-89bc931a5d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf05bab-dd91-4545-9328-89bc931a5d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bb56d1-78c4-43b5-a92f-5b2c9c268d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume 2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d', 'volume_size': 1} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:35 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 Jul 28 16:36:35 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:35 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.391s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Deleted volume successfully. Jul 28 16:36:35 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-473888eb-a026-4f32-a759-b41beec642e3 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-b439b057-2fbc-400a-b021-d0741c1316e1-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c" returned: 0 in 0.662s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:35 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c Jul 28 16:36:35 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:35 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905" returned: 0 in 0.414s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461847043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9643a0bc-e5c2-4f74-8d96-2d384852cf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:34Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Creating volume 9643a0bc-e5c2-4f74-8d96-2d384852cf5a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:35 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd45e5f-716e-458a-b0a0-0c313668538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094e8d19-26fc-43b8-9223-3c81f6d09905', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b581f93a-91f3-4a19-bdd2-cc02dc60f16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a 1073741824 Jul 28 16:36:35 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (52657b89-88e0-4029-9884-55c778f1d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60696932-dd7c-452f-acc2-2402324a49cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume volume-094e8d19-26fc-43b8-9223-3c81f6d09905 (094e8d19-26fc-43b8-9223-3c81f6d09905): created successfully Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b581f93a-91f3-4a19-bdd2-cc02dc60f16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (b98dc1d7-13d0-4c7e-86ce-4583799e2695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60696932-dd7c-452f-acc2-2402324a49cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808874718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0aed11-15f0-488c-b0ef-0ea0d0af673f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:35Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38c5704-61ad-4f7e-9889-f065aebeb1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38c5704-61ad-4f7e-9889-f065aebeb1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16aa83f6-dcb7-4b89-b7c9-909a46995084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16aa83f6-dcb7-4b89-b7c9-909a46995084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0aed11-15f0-488c-b0ef-0ea0d0af673f', 'volume_name': 'volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62349573-9b36-4b05-b563-67f5da477315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62349573-9b36-4b05-b563-67f5da477315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62c0145-0b57-47d0-bb08-3dd07b60b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:35 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume cd0aed11-15f0-488c-b0ef-0ea0d0af673f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f', 'volume_size': 1} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a28aba53-8930-4128-9827-ec252d053a3f tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created volume successfully. Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:DELETE=17,cinder:SELECT=146,cinder:INSERT=35,cinder:UPDATE=175 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-ee9f3a58-866d-4192-af0a-fde7cb5c0c34-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-ee9f3a58-866d-4192-af0a-fde7cb5c0c34-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:35 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0d7ee462-2e21-46ad-a92d-8aa61d74c02c" returned: 0 in 0.514s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Lock "cinder-quobyte-0d7ee462-2e21-46ad-a92d-8aa61d74c02c" released by "delete_volume" :: held 1.265s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Acquiring lock "cinder-quobyte-7df93876-e3e1-4dfa-a9bb-d7487f57efab" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Lock "cinder-quobyte-7df93876-e3e1-4dfa-a9bb-d7487f57efab" acquired by "delete_volume" :: waited 0.051s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-quobyte-ee9f3a58-866d-4192-af0a-fde7cb5c0c34" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[32621598-1963-4e40-93f6-9f62aec6fb27]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-ee9f3a58-866d-4192-af0a-fde7cb5c0c34" acquired by "delete_volume" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00173e6-3f6a-4588-9288-30e1fc5363cb]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (ed27046a-0dc0-4bec-83fc-c055f0c9660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35dee65-77f0-4ec2-a57d-3165f0ee3e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:36 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab Jul 28 16:36:36 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35dee65-77f0-4ec2-a57d-3165f0ee3e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378073716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fb7a17-a2f2-436d-b668-fe58855f2b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:36Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a425190d-71c3-4987-b86c-1294b39b97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a425190d-71c3-4987-b86c-1294b39b97dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7d3d66-a3d6-45ff-81e7-06021caa4aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7d3d66-a3d6-45ff-81e7-06021caa4aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fb7a17-a2f2-436d-b668-fe58855f2b2c', 'volume_name': 'volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b63e19b-8ef1-47f7-b378-b3b2e0a8e9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b63e19b-8ef1-47f7-b378-b3b2e0a8e9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:36 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 Jul 28 16:36:36 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9b8138-94e5-4da8-b56f-72c77d853a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:36 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:36 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume 39fb7a17-a2f2-436d-b668-fe58855f2b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c', 'volume_size': 1} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a 1073741824" returned: 0 in 0.753s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:36 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a Jul 28 16:36:36 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:36 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab" returned: 0 in 0.433s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:36 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab Jul 28 16:36:36 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:36 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34" returned: 0 in 0.456s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:36 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34 Jul 28 16:36:36 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:36 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a" returned: 0 in 0.300s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122334741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:35Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Creating volume 2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:36 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc29a86-c900-4c52-9987-fc1b92c76afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a853e9b5-1907-44c3-ab3c-b1624b86adaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:36 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d 1073741824 Jul 28 16:36:36 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:36 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a (9643a0bc-e5c2-4f74-8d96-2d384852cf5a): created successfully Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a853e9b5-1907-44c3-ab3c-b1624b86adaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (f1d3e860-5e2c-4d92-8c66-42dfea57efb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-34527f31-e9f2-4951-a721-70c1330db22d tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created volume successfully. Jul 28 16:36:36 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7df93876-e3e1-4dfa-a9bb-d7487f57efab" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Lock "cinder-quobyte-7df93876-e3e1-4dfa-a9bb-d7487f57efab" released by "delete_volume" :: held 0.805s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:36 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ee9f3a58-866d-4192-af0a-fde7cb5c0c34" returned: 0 in 0.330s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-ee9f3a58-866d-4192-af0a-fde7cb5c0c34" released by "delete_volume" :: held 0.834s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Created reservations ['9a3e1119-e1d0-4123-8e31-a6fc3262426b'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:36 devstack cinder-volume[88286]: WARNING cinder.quota [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-173482313 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-173482313, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:36:36 devstack cinder-volume[88286]: WARNING cinder.quota [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-173482313 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-173482313, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created reservations ['a2135f07-39af-42fa-b832-b5395dfbfdea', 'fd480930-7447-487f-8b30-7ad4d690c398', 'a5c56239-bfae-463b-8ccb-9afbd1002ae8', 'b600384c-062a-4380-9bef-c5c8c630ccc2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:36 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Created reservations ['4a63317a-06bf-4f28-94a5-3bb6a41d4bec', '760eb5cf-dc5f-427d-b444-5d768018cc7c', '7941af34-15fa-4a60-9b18-34e2330a0aab', 'c79acbd9-da33-4327-85dc-443994389c37'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:37 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:37 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Created reservations ['9c9e11ff-35a9-45d1-8f6f-d7add73077df', 'c1ea2b5f-738f-4a74-92c3-2fac43b8fa76', 'e2b8f075-e0b4-41e9-963a-fa3a6e67cbd5', 'cf0b3a6e-7163-4ecf-bd0f-d5f0d5c545a5'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:37 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d 1073741824" returned: 0 in 0.673s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:37 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d Jul 28 16:36:37 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:37 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:37 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:37 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.306s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Deleted volume successfully. Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-72216af6-4151-49a5-8c2d-5a61b905eae6 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-ee9f3a58-866d-4192-af0a-fde7cb5c0c34-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:37 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d" returned: 0 in 0.318s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808874718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0aed11-15f0-488c-b0ef-0ea0d0af673f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:35Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Creating volume cd0aed11-15f0-488c-b0ef-0ea0d0af673f {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:37 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:37 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f 1073741824 Jul 28 16:36:37 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bb56d1-78c4-43b5-a92f-5b2c9c268d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a87302-83ee-4e38-a276-1732ded25d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:37 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d (2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d): created successfully Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a87302-83ee-4e38-a276-1732ded25d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:37 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (74e2c3de-7456-496a-b86d-ee004e031b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.342s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:37 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d532a1b0-2dbc-436a-b3ee-695a5b09cc7e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created volume successfully. Jul 28 16:36:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8ab58b7b-e310-46f4-b4d7-e2d15fda938c tempest-GroupsTest-491137244 None] Delete group completed successfully. Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-6cddca97-f9c1-46ed-8a2c-9db42d2ac451-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-6cddca97-f9c1-46ed-8a2c-9db42d2ac451-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "cinder-quobyte-6cddca97-f9c1-46ed-8a2c-9db42d2ac451" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:38 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-6cddca97-f9c1-46ed-8a2c-9db42d2ac451" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f 1073741824" returned: 0 in 0.555s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf306fda-5d3e-49c4-a7f9-7326c177e3a8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:38 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f Jul 28 16:36:38 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:38 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 Jul 28 16:36:38 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:38 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378073716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fb7a17-a2f2-436d-b668-fe58855f2b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5b3b489ecc40798a2b7836835f04b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:36Z,use_quota=True,user_id='42b0b1bf3a7c41c9972b14fc434da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Creating volume 39fb7a17-a2f2-436d-b668-fe58855f2b2c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:38 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62c0145-0b57-47d0-bb08-3dd07b60b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:38 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c 1073741824 Jul 28 16:36:38 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d946e72-ac5e-409b-a0bb-79549a18f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:38 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f (cd0aed11-15f0-488c-b0ef-0ea0d0af673f): created successfully Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d946e72-ac5e-409b-a0bb-79549a18f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (52657b89-88e0-4029-9884-55c778f1d485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:38 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-35842d8b-704e-4611-b205-580037a39ae0 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created volume successfully. Jul 28 16:36:38 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451" returned: 0 in 0.498s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:38 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451 Jul 28 16:36:38 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:38 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6cddca97-f9c1-46ed-8a2c-9db42d2ac451" returned: 0 in 0.336s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-quobyte-6cddca97-f9c1-46ed-8a2c-9db42d2ac451" released by "delete_volume" :: held 0.892s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=172,cinder:INSERT=50,cinder:UPDATE=210,cinder:DELETE=16 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Created reservations ['7e64410c-0dfc-466a-a12c-6c20d374d823', '708fa527-3549-42ef-809f-d20126945f97', '7c8ca8df-4e4e-417d-b29b-969f20c09c5e', '8843590d-f46f-40f7-835b-561fcd7cd7bc'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:39 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c 1073741824" returned: 0 in 0.649s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:39 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c Jul 28 16:36:39 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:39 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:39 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:39 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c" returned: 0 in 0.368s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9b8138-94e5-4da8-b56f-72c77d853a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc7152-7bf7-4d35-aed2-373580b86fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:39 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Volume volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c (39fb7a17-a2f2-436d-b668-fe58855f2b2c): created successfully Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc7152-7bf7-4d35-aed2-373580b86fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Flow 'volume_create_manager' (ed27046a-0dc0-4bec-83fc-c055f0c9660d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:39 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:39 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Deleted volume successfully. Jul 28 16:36:39 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7b9fa035-da48-4a46-bce8-d8b7f14b13ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created volume successfully. Jul 28 16:36:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-109ce82f-e67f-430c-b385-4fee9e99b260 tempest-CreateVolumesFromSourceVolumeTest-643027836 None] Lock "cinder-6cddca97-f9c1-46ed-8a2c-9db42d2ac451-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-39fb7a17-a2f2-436d-b668-fe58855f2b2c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-39fb7a17-a2f2-436d-b668-fe58855f2b2c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-39fb7a17-a2f2-436d-b668-fe58855f2b2c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:40 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-39fb7a17-a2f2-436d-b668-fe58855f2b2c" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[211a7eac-4efa-4220-bc71-8053627a5b55]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:40 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c Jul 28 16:36:40 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:41 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:41 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:41 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c" returned: 0 in 0.521s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:41 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c Jul 28 16:36:41 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:41 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.379s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:36:41 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39fb7a17-a2f2-436d-b668-fe58855f2b2c" returned: 0 in 0.363s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-39fb7a17-a2f2-436d-b668-fe58855f2b2c" released by "delete_volume" :: held 0.957s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created reservations ['389d5f95-c267-41d9-bc8e-3f243d106d64', 'd6915fa0-d12c-4592-aca6-4cacab432ad9', '85915a5e-eefb-4f35-b7dd-46d37e414ce7', '5aed8589-323c-4619-a0bc-231a81ec55d0'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:41 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:41 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:42 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.407s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:42 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Deleted volume successfully. Jul 28 16:36:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-28d73335-2701-4c80-9bef-248c694638b3 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-39fb7a17-a2f2-436d-b668-fe58855f2b2c-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-cd0aed11-15f0-488c-b0ef-0ea0d0af673f-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-cd0aed11-15f0-488c-b0ef-0ea0d0af673f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-cd0aed11-15f0-488c-b0ef-0ea0d0af673f" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-cd0aed11-15f0-488c-b0ef-0ea0d0af673f" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09af6e1-6f77-4d5c-9e94-2d21edaf0ac2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:43 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f Jul 28 16:36:43 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:43 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f" returned: 0 in 0.464s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:43 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f Jul 28 16:36:43 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:43 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cd0aed11-15f0-488c-b0ef-0ea0d0af673f" returned: 0 in 0.314s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-cd0aed11-15f0-488c-b0ef-0ea0d0af673f" released by "delete_volume" :: held 0.825s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:43 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created reservations ['0f163ad5-fa7c-465f-826d-fdf75a0222f8', '9b0d9ffc-23c0-49d9-89e3-3d8c07b16ef4', 'a7746ea6-e087-457b-9426-6b09f197e13f', '851f17ec-efad-41b4-8268-75dd86e71212'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:44 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:44 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (b0f48762-abe2-4dc1-88c0-57410d183fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de357d0b-fff1-4169-832f-9ae9441c0ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de357d0b-fff1-4169-832f-9ae9441c0ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640610126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0642df19-9e41-4891-af7d-fd0d96121040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:44Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb999cd-24ad-48aa-9474-0127f8916e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb999cd-24ad-48aa-9474-0127f8916e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3756d8-35d0-4d62-af30-34621773a5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3756d8-35d0-4d62-af30-34621773a5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0642df19-9e41-4891-af7d-fd0d96121040', 'volume_name': 'volume-0642df19-9e41-4891-af7d-fd0d96121040', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c312fe4-9a3a-40fe-9581-64d3fd515c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c312fe4-9a3a-40fe-9581-64d3fd515c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4564b9-d8fd-4a8c-8502-acf5f2bfe607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Volume 0642df19-9e41-4891-af7d-fd0d96121040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0642df19-9e41-4891-af7d-fd0d96121040', 'volume_size': 1} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640610126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0642df19-9e41-4891-af7d-fd0d96121040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:44Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Creating volume 0642df19-9e41-4891-af7d-fd0d96121040 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:44 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 1073741824 Jul 28 16:36:44 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d" acquired by "delete_volume" :: waited 0.038s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a78ca-2a9d-4c07-8ffe-e18fa54cf6d4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:44 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.480s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Deleted volume successfully. Jul 28 16:36:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f2f3a33e-9016-472f-9ef9-4da2e306a67e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-cd0aed11-15f0-488c-b0ef-0ea0d0af673f-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:44 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d Jul 28 16:36:44 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:45 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d" returned: 0 in 0.445s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:45 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 1073741824" returned: 0 in 0.574s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:45 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d Jul 28 16:36:45 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:45 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 Jul 28 16:36:45 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:45 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d" returned: 0 in 0.329s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d" released by "delete_volume" :: held 0.846s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:45 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040" returned: 0 in 0.323s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4564b9-d8fd-4a8c-8502-acf5f2bfe607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0642df19-9e41-4891-af7d-fd0d96121040', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ab79c4-5a6f-423d-b4aa-28f238a0587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Volume volume-0642df19-9e41-4891-af7d-fd0d96121040 (0642df19-9e41-4891-af7d-fd0d96121040): created successfully Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ab79c4-5a6f-423d-b4aa-28f238a0587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (b0f48762-abe2-4dc1-88c0-57410d183fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6743374a-f518-4791-84e2-94a6c75f74d5 tempest-ProjectReaderTests-1171896592 None] Created volume successfully. Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created reservations ['a69b62e1-f9bc-4d57-96f5-6d7fcdd04bac', '84d4efa1-2d3c-43f8-bd02-56176bf11d2e', 'b231bfc7-983f-46aa-a89c-5d88bcdd81cf', '9b8f058c-9c14-4d2f-99d4-dd401896ab52'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:45 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:45 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-26c22566-de53-439a-90b3-405cad57a120 tempest-GroupsV320Test-1987812767 None] Group tempest-GroupsV320Test-Group-1226612262: creating Jul 28 16:36:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-26c22566-de53-439a-90b3-405cad57a120 tempest-GroupsV320Test-1987812767 None] Group tempest-GroupsV320Test-Group-1226612262: created successfully Jul 28 16:36:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-26c22566-de53-439a-90b3-405cad57a120 tempest-GroupsV320Test-1987812767 None] Create group completed successfully. Jul 28 16:36:45 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.278s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Deleted volume successfully. Jul 28 16:36:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8a876b54-ec3d-438a-b2b7-b947ad72b4ae tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-2991bb5b-c9aa-4ddd-a31b-ae3d571d9f6d-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-0642df19-9e41-4891-af7d-fd0d96121040-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-9643a0bc-e5c2-4f74-8d96-2d384852cf5a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-0642df19-9e41-4891-af7d-fd0d96121040-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-9643a0bc-e5c2-4f74-8d96-2d384852cf5a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-quobyte-0642df19-9e41-4891-af7d-fd0d96121040" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-9643a0bc-e5c2-4f74-8d96-2d384852cf5a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-0642df19-9e41-4891-af7d-fd0d96121040" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-9643a0bc-e5c2-4f74-8d96-2d384852cf5a" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c03143d-62ec-49b9-a8a4-0951621beb84]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2eea1d-3cf2-42c4-bb0f-82f95414ee17]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:46 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 Jul 28 16:36:46 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:46 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a Jul 28 16:36:46 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:47 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040" returned: 0 in 0.426s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:47 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040 Jul 28 16:36:47 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:47 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a" returned: 0 in 0.484s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:47 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a Jul 28 16:36:47 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:47 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0642df19-9e41-4891-af7d-fd0d96121040" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-0642df19-9e41-4891-af7d-fd0d96121040" released by "delete_volume" :: held 0.798s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Created reservations ['03c81fb8-aabf-4349-99ce-e5db9100ff6a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:47 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-9643a0bc-e5c2-4f74-8d96-2d384852cf5a" returned: 0 in 0.345s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-9643a0bc-e5c2-4f74-8d96-2d384852cf5a" released by "delete_volume" :: held 0.904s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Created reservations ['94b2581d-90d9-4650-b42e-5fbc1a0f6252', 'd054174f-52d7-46bb-bc10-2d34cbdd8770', 'f45964c4-8700-46ad-98a2-d4557b4d36dd', '1ad48e16-c03f-406a-ba83-77d827b7c238'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:47 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:47 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created reservations ['e75d4502-f796-4a7d-a0a4-ed5bd1695778', '18cf1d04-0e62-4bb6-813f-a99e982c7ac7', '4512a672-41f2-44b8-bbb3-696d454f7e21', '3d5aa3c0-bf50-48cb-ba42-b072b13aaa55'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:47 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:47 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:47 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:47 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:47 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.348s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:47 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4ca3d5e7-75fb-4232-86e9-08bf1bca11bc tempest-GroupsV320Test-1987812767 None] Delete group completed successfully. Jul 28 16:36:48 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:48 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Deleted volume successfully. Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-82d7a4be-7c5f-47d3-8142-7fb87cdfdc6c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-0642df19-9e41-4891-af7d-fd0d96121040-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:48 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.339s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:48 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Deleted volume successfully. Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6bd9a836-0821-4711-9cf2-c6d862202c0e tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-9643a0bc-e5c2-4f74-8d96-2d384852cf5a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (19a50fd7-144e-426e-ba22-503e9214b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69aa9ee-ecc8-419b-a3cc-2b9543a1b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69aa9ee-ecc8-419b-a3cc-2b9543a1b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979741268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b8828c-1b2a-41d4-b122-ccb9413ffc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:48Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66275865-626c-44a1-94bd-bd4853c09730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66275865-626c-44a1-94bd-bd4853c09730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0c99e1-670b-42c3-b776-810591a56ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0c99e1-670b-42c3-b776-810591a56ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b8828c-1b2a-41d4-b122-ccb9413ffc30', 'volume_name': 'volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f761b8a3-6ae3-47f1-8240-8818655c76e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f761b8a3-6ae3-47f1-8240-8818655c76e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9979396-ab2d-45f5-8688-89535e0e895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:48 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Volume 52b8828c-1b2a-41d4-b122-ccb9413ffc30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30', 'volume_size': 1} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979741268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b8828c-1b2a-41d4-b122-ccb9413ffc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:48Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Creating volume 52b8828c-1b2a-41d4-b122-ccb9413ffc30 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:48 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:48 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 1073741824 Jul 28 16:36:48 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-094e8d19-26fc-43b8-9223-3c81f6d09905-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-094e8d19-26fc-43b8-9223-3c81f6d09905-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-094e8d19-26fc-43b8-9223-3c81f6d09905" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-094e8d19-26fc-43b8-9223-3c81f6d09905" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e80dc6-27d1-4a3a-83d3-f1b1d669da01]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:49 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 1073741824" returned: 0 in 0.629s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:49 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 Jul 28 16:36:49 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:49 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 Jul 28 16:36:49 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:49 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905" returned: 0 in 0.434s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:49 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905 Jul 28 16:36:49 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:49 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30" returned: 0 in 0.332s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9979396-ab2d-45f5-8688-89535e0e895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68c18ee-67a4-4732-afaa-1bb4f4d53cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:49 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Volume volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 (52b8828c-1b2a-41d4-b122-ccb9413ffc30): created successfully Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68c18ee-67a4-4732-afaa-1bb4f4d53cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (19a50fd7-144e-426e-ba22-503e9214b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ed6dbbdb-9c3b-402d-ba85-2c529f184bb5 tempest-ProjectReaderTests-1171896592 None] Created volume successfully. Jul 28 16:36:49 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-094e8d19-26fc-43b8-9223-3c81f6d09905" returned: 0 in 0.301s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-094e8d19-26fc-43b8-9223-3c81f6d09905" released by "delete_volume" :: held 0.784s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created reservations ['dcfee461-107f-4376-8cca-1dffbc0ef546', '5179e567-7708-4dd6-bd3f-09453eecb3cd', 'aa626b0f-6b08-4fd0-a8b5-88119e8f2ba7', '1c0cfcee-df30-4a17-baee-945cc91ad289'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:49 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:49 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-3fdb1776-5a51-4d0e-ae61-ad7faca6815e-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-3fdb1776-5a51-4d0e-ae61-ad7faca6815e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-7a86be6c-939f-4048-9496-2175842bc1b3" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-7a86be6c-939f-4048-9496-2175842bc1b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-3fdb1776-5a51-4d0e-ae61-ad7faca6815e" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-3fdb1776-5a51-4d0e-ae61-ad7faca6815e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Deleting offline snapshot 3fdb1776-5a51-4d0e-ae61-ad7faca6815e of volume 7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] snapshot_file for this snap is: volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfb8d99-deb5-449a-9076-9f3e3464abe2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:50 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.352s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Deleted volume successfully. Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7e02f5a0-128c-4631-9686-6da7f200f546 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-094e8d19-26fc-43b8-9223-3c81f6d09905-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:50 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e Jul 28 16:36:50 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-52b8828c-1b2a-41d4-b122-ccb9413ffc30-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Lock "cinder-52b8828c-1b2a-41d4-b122-ccb9413ffc30-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-quobyte-52b8828c-1b2a-41d4-b122-ccb9413ffc30" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-52b8828c-1b2a-41d4-b122-ccb9413ffc30" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:50 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e" returned: 0 in 0.503s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a86be6c-939f-4048-9496-2175842bc1b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad982e7-b87d-4008-8789-be709a6c2220]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3896637-c8c2-4b3e-8518-cf48a66ba559]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:50 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 Jul 28 16:36:50 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:50 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 Jul 28 16:36:50 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:51 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30" returned: 0 in 0.480s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:51 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3" returned: 0 in 0.480s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:51 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30 Jul 28 16:36:51 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:51 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e Jul 28 16:36:51 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:51 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-52b8828c-1b2a-41d4-b122-ccb9413ffc30" returned: 0 in 0.340s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-52b8828c-1b2a-41d4-b122-ccb9413ffc30" released by "delete_volume" :: held 0.898s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Created reservations ['ba6bb0ae-9ccb-4f11-8bbd-b0ed49749224', '27986bdd-58e6-4024-b12f-d82da75e9b47', 'a812cf7c-d21b-4716-b92e-789f28ceec1e', 'f158f00d-ed3f-46b4-97a1-eb4f2c15d537'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:51 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:51 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e Jul 28 16:36:51 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:51 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:51 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:52 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3.3fdb1776-5a51-4d0e-ae61-ad7faca6815e" returned: 0 in 0.460s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:52 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.444s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-3fdb1776-5a51-4d0e-ae61-ad7faca6815e" released by "_delete_snapshot" :: held 2.103s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Deleted volume successfully. Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-7a86be6c-939f-4048-9496-2175842bc1b3" released by "delete_snapshot" :: held 2.146s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-36fb7839-d489-41fa-a4c9-3a56f7d506ac tempest-ProjectReaderTests-1171896592 None] Lock "cinder-52b8828c-1b2a-41d4-b122-ccb9413ffc30-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created reservations ['f587150c-d72a-4a03-9c2b-c4c5ef93a4a3', 'c616f087-913f-4cb8-ac51-5bd4aa4d4423', 'b0fa70b5-b9cc-4594-86be-c9ec2bd1ab3f', '3a29bafa-6a5d-4159-8b60-12a0e6ce0617'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Delete snapshot completed successfully. Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-eb6d63e8-6187-44bd-80c8-993767b44d56 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-3fdb1776-5a51-4d0e-ae61-ad7faca6815e-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (9bdaed27-7759-4b5d-8601-686bc5af8e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbefb2a1-4a60-4e41-a00e-4ed31032e481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbefb2a1-4a60-4e41-a00e-4ed31032e481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034680624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471d0fa7-a10d-4bdc-b351-eda6dbb137c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:53Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cfca63c-11b2-400c-a0a6-169a53bb6ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cfca63c-11b2-400c-a0a6-169a53bb6ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382267f3-ab59-42fe-9ef1-2653c3297936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382267f3-ab59-42fe-9ef1-2653c3297936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471d0fa7-a10d-4bdc-b351-eda6dbb137c8', 'volume_name': 'volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bec0a3-37f5-40a8-ba61-d36e2daac191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bec0a3-37f5-40a8-ba61-d36e2daac191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c59941c-26ff-4c40-970f-aed726f7be6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Volume 471d0fa7-a10d-4bdc-b351-eda6dbb137c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8', 'volume_size': 1} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034680624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471d0fa7-a10d-4bdc-b351-eda6dbb137c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:53Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Creating volume 471d0fa7-a10d-4bdc-b351-eda6dbb137c8 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:52 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:52 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 1073741824 Jul 28 16:36:52 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:53 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 1073741824" returned: 0 in 0.492s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:53 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 Jul 28 16:36:53 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-7a86be6c-939f-4048-9496-2175842bc1b3-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-7a86be6c-939f-4048-9496-2175842bc1b3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "cinder-quobyte-7a86be6c-939f-4048-9496-2175842bc1b3" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-7a86be6c-939f-4048-9496-2175842bc1b3" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dd8228-cb75-4d19-8402-06bc6dcad8fe]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:53 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8" returned: 0 in 0.342s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c59941c-26ff-4c40-970f-aed726f7be6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0181ddd1-99a2-4ca2-8b21-31540f32ba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Volume volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 (471d0fa7-a10d-4bdc-b351-eda6dbb137c8): created successfully Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0181ddd1-99a2-4ca2-8b21-31540f32ba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (9bdaed27-7759-4b5d-8601-686bc5af8e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-70a7c5ea-1d90-422d-b6dc-8894aeceb57e tempest-ProjectReaderTests-1171896592 None] Created volume successfully. Jul 28 16:36:53 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 Jul 28 16:36:53 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:53 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3" returned: 0 in 0.411s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:53 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3 Jul 28 16:36:53 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:54 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7a86be6c-939f-4048-9496-2175842bc1b3" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-quobyte-7a86be6c-939f-4048-9496-2175842bc1b3" released by "delete_volume" :: held 0.795s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Created reservations ['9219af2b-7411-43a6-ae3e-a6bb5df1eacd', '00ee01a7-fdd3-4112-9d21-5dc35cb54335', 'ab056ff6-ce78-43a5-ab65-21570168908a', 'bcdb7531-d2d1-496e-ba47-e5d008df1217'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:54 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:54 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:54 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-471d0fa7-a10d-4bdc-b351-eda6dbb137c8-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.343s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Deleted volume successfully. Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-471d0fa7-a10d-4bdc-b351-eda6dbb137c8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-97908428-c0e9-4fd8-9cd2-aacb1dedfa17 tempest-CreateVolumesFromSnapshotTest-1781621193 None] Lock "cinder-7a86be6c-939f-4048-9496-2175842bc1b3-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-quobyte-471d0fa7-a10d-4bdc-b351-eda6dbb137c8" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-471d0fa7-a10d-4bdc-b351-eda6dbb137c8" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e30753-9bf4-4a50-9bb1-9389cc7be8b2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:55 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 Jul 28 16:36:55 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:55 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:55 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8 Jul 28 16:36:55 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:55 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-471d0fa7-a10d-4bdc-b351-eda6dbb137c8" returned: 0 in 0.352s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-471d0fa7-a10d-4bdc-b351-eda6dbb137c8" released by "delete_volume" :: held 0.853s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Created reservations ['f46f5860-2a45-4fd3-8362-5ba3b2aea733', '9fd4795e-107a-47c2-b951-8326399019c9', 'c7bb152a-dc7e-4a4c-88a9-15660434e7d8', '37af4644-59a9-4e1e-8fc7-3ce0d1a9bb87'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:55 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:36:55 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:56 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.465s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:36:56 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Deleted volume successfully. Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-5cc07eec-1cb3-4190-a555-474b0b5ded0c tempest-ProjectReaderTests-1171896592 None] Lock "cinder-471d0fa7-a10d-4bdc-b351-eda6dbb137c8-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (d4854b13-2a98-465b-a7fd-fc273b5c7ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e26eb63-4cf5-41c5-afa0-e9548e897c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e26eb63-4cf5-41c5-afa0-e9548e897c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143891591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e72806-9e4b-4d9a-9265-ff354cb0cf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:57Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f89200-6fcc-4d8f-834b-0aa27bf75b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f89200-6fcc-4d8f-834b-0aa27bf75b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8717bc-c364-455b-8040-25806903bb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8717bc-c364-455b-8040-25806903bb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e72806-9e4b-4d9a-9265-ff354cb0cf9d', 'volume_name': 'volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5362810d-e23b-4314-a976-58000308b7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5362810d-e23b-4314-a976-58000308b7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38bbee9-2d20-41a0-8e26-5b039ae0b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:56 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Volume 39e72806-9e4b-4d9a-9265-ff354cb0cf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d', 'volume_size': 1} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143891591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e72806-9e4b-4d9a-9265-ff354cb0cf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada4e0213fa4665ba641c092ed36a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:36:57Z,use_quota=True,user_id='dc484a5ec99d42f1bec4209477c91ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Creating volume 39e72806-9e4b-4d9a-9265-ff354cb0cf9d {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:36:56 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:36:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:56 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d 1073741824 Jul 28 16:36:56 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:57 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d 1073741824" returned: 0 in 0.544s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:57 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d Jul 28 16:36:57 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:57 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38bbee9-2d20-41a0-8e26-5b039ae0b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9016e201-058b-41ea-98c8-59cea3fc40aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:36:57 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Volume volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d (39e72806-9e4b-4d9a-9265-ff354cb0cf9d): created successfully Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9016e201-058b-41ea-98c8-59cea3fc40aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:36:57 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Flow 'volume_create_manager' (d4854b13-2a98-465b-a7fd-fc273b5c7ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:36:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4d577dfc-5cec-4f8a-821d-3d54c71783f1 tempest-ProjectReaderTests-1171896592 None] Created volume successfully. Jul 28 16:36:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-39e72806-9e4b-4d9a-9265-ff354cb0cf9d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Lock "cinder-39e72806-9e4b-4d9a-9265-ff354cb0cf9d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "cinder-quobyte-39e72806-9e4b-4d9a-9265-ff354cb0cf9d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:36:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-39e72806-9e4b-4d9a-9265-ff354cb0cf9d" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:36:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f5f3d-7d95-4cc1-b6e1-04e70ddd0794]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:36:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:59 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d Jul 28 16:36:59 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:59 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d" returned: 0 in 0.474s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:36:59 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d Jul 28 16:36:59 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:36:59 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Jul 28 16:36:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-39e72806-9e4b-4d9a-9265-ff354cb0cf9d" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:36:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Lock "cinder-quobyte-39e72806-9e4b-4d9a-9265-ff354cb0cf9d" released by "delete_volume" :: held 0.853s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:36:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Created reservations ['0e761a7b-5181-4843-9605-b987b8704846', '99942c72-2281-4d78-af22-597563e71469', 'dafb2484-a18c-4011-8f36-1102b13cdfec', 'b6e940ca-564a-44ed-aa36-43b40746829e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:00 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:37:00 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:00 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:37:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Deleted volume successfully. Jul 28 16:37:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c792feb7-2670-4910-a34a-58f44a04d572 tempest-ProjectReaderTests-1171896592 None] Lock "cinder-39e72806-9e4b-4d9a-9265-ff354cb0cf9d-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Flow 'volume_create_manager' (5be8ee87-2fe4-4486-8081-0e88b78f398f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b5303f-783d-4ec5-a42b-3cb8d53f82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b5303f-783d-4ec5-a42b-3cb8d53f82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8f922a-c7fb-4960-b7c8-fb6403d82eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4724399f89431ab3c2efb34a76aaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:02Z,use_quota=True,user_id='080c9ef9199947b690c24a0bb7af9cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb2b482-624e-46a3-b9d3-8267674e3520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb2b482-624e-46a3-b9d3-8267674e3520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151dcc4-326d-4b36-b268-11b0a8b6c703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:02 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151dcc4-326d-4b36-b268-11b0a8b6c703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e8f922a-c7fb-4960-b7c8-fb6403d82eab', 'volume_name': 'volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab', 'volume_size': 1, 'image_id': 'e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51f0f0c94cf9587c378a2f9098d32a64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd4724399f89431ab3c2efb34a76aaf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15cec4270e99ec451dfc434ace6f27690753664b3de886629d020c47f57d711232e5d1e1e87f9e2f6c02845787d538f14798968ed8a758fdec63b02caececb3d', 'id': 'e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'created_at': datetime.datetime(2026, 7, 28, 14, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe/file', 'properties': {}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e5115c-c334-4958-b41f-b4a35d82ceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e5115c-c334-4958-b41f-b4a35d82ceb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197bd806-57c4-45cc-9561-c9274a09524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:03 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Volume 1e8f922a-c7fb-4960-b7c8-fb6403d82eab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab', 'volume_size': 1, 'image_id': 'e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51f0f0c94cf9587c378a2f9098d32a64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd4724399f89431ab3c2efb34a76aaf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15cec4270e99ec451dfc434ace6f27690753664b3de886629d020c47f57d711232e5d1e1e87f9e2f6c02845787d538f14798968ed8a758fdec63b02caececb3d', 'id': 'e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'created_at': datetime.datetime(2026, 7, 28, 14, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe/file', 'properties': {}}, 'image_service': } Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Trying to clone 1e8f922a-c7fb-4960-b7c8-fb6403d82eab from image e59c541b-d5bb-4cbe-929f-e36f271e90fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:37:03 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Image download 0.00 MB at 0.00 MB/s Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f4acd6-45c4-4d57-80e6-8ddcfe1c628f]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:03 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD Jul 28 16:37:03 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:03 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:03 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD Jul 28 16:37:03 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:04 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Temporary image e59c541b-d5bb-4cbe-929f-e36f271e90fe is fetched for user 080c9ef9199947b690c24a0bb7af9cda. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d944ed-20c1-4826-8a88-64c22b811c4f]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:04 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD Jul 28 16:37:04 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:04 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:04 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD Jul 28 16:37:04 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:04 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8f922a-c7fb-4960-b7c8-fb6403d82eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4724399f89431ab3c2efb34a76aaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:02Z,use_quota=True,user_id='080c9ef9199947b690c24a0bb7af9cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Creating volume 1e8f922a-c7fb-4960-b7c8-fb6403d82eab {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:37:04 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:37:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:04 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab 1073741824 Jul 28 16:37:04 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:05 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab 1073741824" returned: 0 in 0.579s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:05 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab Jul 28 16:37:05 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:05 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab" returned: 0 in 0.306s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Attempting download of e59c541b-d5bb-4cbe-929f-e36f271e90fe ((None, [{'url': 'file:///opt/stack/data/glance/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'metadata': {}}])) to volume 1e8f922a-c7fb-4960-b7c8-fb6403d82eab. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca55730-aa1a-4b5d-afdb-3f42eab803dc]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e59c541b-d5bb-4cbe-929f-e36f271e90fe_momjide0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:06 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e59c541b-d5bb-4cbe-929f-e36f271e90fe_momjide0 Jul 28 16:37:06 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:06 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e59c541b-d5bb-4cbe-929f-e36f271e90fe_momjide0" returned: 0 in 0.390s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59c541b-d5bb-4cbe-929f-e36f271e90fe_momjide0 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:06 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59c541b-d5bb-4cbe-929f-e36f271e90fe_momjide0 Jul 28 16:37:06 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:06 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59c541b-d5bb-4cbe-929f-e36f271e90fe_momjide0" returned: 1 in 0.389s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59c541b-d5bb-4cbe-929f-e36f271e90fe_momjide0' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:37:06 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4239c87e-a3f9-4343-8e27-edaff03e7c54]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:06 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD Jul 28 16:37:06 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:07 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:07 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD Jul 28 16:37:07 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:07 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:37:07 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] e59c541b-d5bb-4cbe-929f-e36f271e90fe was raw, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:37:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:07 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab Jul 28 16:37:07 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:08 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab" returned: 0 in 0.548s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e59c541b-d5bb-4cbe-929f-e36f271e90fe_olz9bvvgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:37:08 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:08 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab 1G Jul 28 16:37:08 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:08 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab 1G" returned: 0 in 0.412s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Downloaded image e59c541b-d5bb-4cbe-929f-e36f271e90fe ((None, [{'url': 'file:///opt/stack/data/glance/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'metadata': {}}])) to volume 1e8f922a-c7fb-4960-b7c8-fb6403d82eab successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Temporary image e59c541b-d5bb-4cbe-929f-e36f271e90fe for user 080c9ef9199947b690c24a0bb7af9cda is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Marking volume 1e8f922a-c7fb-4960-b7c8-fb6403d82eab as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Copying metadata from image e59c541b-d5bb-4cbe-929f-e36f271e90fe to 1e8f922a-c7fb-4960-b7c8-fb6403d82eab. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Creating volume glance metadata for volume 1e8f922a-c7fb-4960-b7c8-fb6403d82eab backed by image e59c541b-d5bb-4cbe-929f-e36f271e90fe with: {'image_id': 'e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '51f0f0c94cf9587c378a2f9098d32a64', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197bd806-57c4-45cc-9561-c9274a09524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab', 'volume_size': 1, 'image_id': 'e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51f0f0c94cf9587c378a2f9098d32a64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd4724399f89431ab3c2efb34a76aaf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15cec4270e99ec451dfc434ace6f27690753664b3de886629d020c47f57d711232e5d1e1e87f9e2f6c02845787d538f14798968ed8a758fdec63b02caececb3d', 'id': 'e59c541b-d5bb-4cbe-929f-e36f271e90fe', 'created_at': datetime.datetime(2026, 7, 28, 14, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e59c541b-d5bb-4cbe-929f-e36f271e90fe/file', 'properties': {}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569c490c-a6c4-4b69-8da8-4598ce4b785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Volume volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab (1e8f922a-c7fb-4960-b7c8-fb6403d82eab): created successfully Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569c490c-a6c4-4b69-8da8-4598ce4b785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Flow 'volume_create_manager' (5be8ee87-2fe4-4486-8081-0e88b78f398f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b6b6232c-6e74-49ff-aa60-12769a5095ec tempest-VolumeImageDependencyTests-2094885813 None] Created volume successfully. Jul 28 16:37:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Acquiring lock "cinder-1e8f922a-c7fb-4960-b7c8-fb6403d82eab-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Lock "cinder-1e8f922a-c7fb-4960-b7c8-fb6403d82eab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Acquiring lock "cinder-quobyte-1e8f922a-c7fb-4960-b7c8-fb6403d82eab" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Lock "cinder-quobyte-1e8f922a-c7fb-4960-b7c8-fb6403d82eab" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5508fcc-292e-4a99-a077-db2d8ba06c51]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:10 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab Jul 28 16:37:10 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:10 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab" returned: 0 in 0.432s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:10 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab Jul 28 16:37:10 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:10 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1e8f922a-c7fb-4960-b7c8-fb6403d82eab" returned: 0 in 0.296s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Lock "cinder-quobyte-1e8f922a-c7fb-4960-b7c8-fb6403d82eab" released by "delete_volume" :: held 0.779s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Created reservations ['09fe7478-8b46-4a52-a2cf-76ddf4ae32ea', 'e003314d-ff12-41ba-90d9-8169d1c014f4', 'b5b2a2a9-6811-45ec-b52b-c67f3941b707', '32f9a4e4-de9f-43fa-b839-15f903be85d7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:10 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:37:10 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:11 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.286s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:11 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:37:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Deleted volume successfully. Jul 28 16:37:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7d075fb1-ba0f-4eec-a28a-74eb4ff8f294 tempest-VolumeImageDependencyTests-2094885813 None] Lock "cinder-1e8f922a-c7fb-4960-b7c8-fb6403d82eab-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Flow 'volume_create_manager' (180fd4ec-da7b-42e8-9889-5cb691ff5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cc4991-8156-4da6-8993-e2ce7ec1be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cc4991-8156-4da6-8993-e2ce7ec1be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4516058-829e-449f-b0e6-81bdf323195f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd2bb0b3c24f70a2523082c68e72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:15Z,use_quota=True,user_id='3ba3bb0d06174f0f944271625329fd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61724668-2382-44a5-a488-460ab6a58666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61724668-2382-44a5-a488-460ab6a58666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5f42bc-1763-4bd5-bcd2-fcbc9628dec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5f42bc-1763-4bd5-bcd2-fcbc9628dec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4516058-829e-449f-b0e6-81bdf323195f', 'volume_name': 'volume-c4516058-829e-449f-b0e6-81bdf323195f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf789dd4-b39f-4b4c-8729-986aaf229f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf789dd4-b39f-4b4c-8729-986aaf229f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884926a-85ac-4421-b4dc-e0a1f3c32043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Volume c4516058-829e-449f-b0e6-81bdf323195f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4516058-829e-449f-b0e6-81bdf323195f', 'volume_size': 1} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4516058-829e-449f-b0e6-81bdf323195f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd2bb0b3c24f70a2523082c68e72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:15Z,use_quota=True,user_id='3ba3bb0d06174f0f944271625329fd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Creating volume c4516058-829e-449f-b0e6-81bdf323195f {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:37:15 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:15 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f 1073741824 Jul 28 16:37:15 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:15 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f 1073741824" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:15 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f Jul 28 16:37:15 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:15 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f" returned: 0 in 0.306s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:37:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884926a-85ac-4421-b4dc-e0a1f3c32043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4516058-829e-449f-b0e6-81bdf323195f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21108908-c6e7-4561-8979-0c9c66aca869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:16 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Volume volume-c4516058-829e-449f-b0e6-81bdf323195f (c4516058-829e-449f-b0e6-81bdf323195f): created successfully Jul 28 16:37:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21108908-c6e7-4561-8979-0c9c66aca869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Flow 'volume_create_manager' (180fd4ec-da7b-42e8-9889-5cb691ff5569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:16 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-befa8d48-3650-4596-8e15-e30da46643ff tempest-CinderUnicodeTest-228229012 None] Created volume successfully. Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Flow 'volume_create_manager' (470f4126-6016-4dcd-a69b-86e3059a290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6801a648-8216-4ad7-9a28-227e1ccf87be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6801a648-8216-4ad7-9a28-227e1ccf87be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1143347648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd2bb0b3c24f70a2523082c68e72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:18Z,use_quota=True,user_id='3ba3bb0d06174f0f944271625329fd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6b78b2-3d16-4a23-bb60-f1de6f06e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6b78b2-3d16-4a23-bb60-f1de6f06e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2b001-f7a9-4d1d-bfdd-7dda08a1716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2b001-f7a9-4d1d-bfdd-7dda08a1716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1', 'volume_name': 'volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136adee1-047e-4f08-96a3-9ad0347ef53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136adee1-047e-4f08-96a3-9ad0347ef53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6392d06-5b30-4b74-b220-0cb59c91e684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:17 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Volume 8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1', 'volume_size': 1} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1143347648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd2bb0b3c24f70a2523082c68e72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:18Z,use_quota=True,user_id='3ba3bb0d06174f0f944271625329fd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Creating volume 8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:37:17 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:37:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:17 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 1073741824 Jul 28 16:37:17 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:18 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 1073741824" returned: 0 in 0.514s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:18 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 Jul 28 16:37:18 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:18 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6392d06-5b30-4b74-b220-0cb59c91e684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b81b4f-9368-4ddd-b19a-201c5c527578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:18 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Volume volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 (8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1): created successfully Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b81b4f-9368-4ddd-b19a-201c5c527578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Flow 'volume_create_manager' (470f4126-6016-4dcd-a69b-86e3059a290a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3bef0a5e-a87b-4e9b-b089-2a4e2a59bf30 tempest-CinderUnicodeTest-228229012 None] Created volume successfully. Jul 28 16:37:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Creating offline snapshot 3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 of volume 8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:37:20 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cedd7fe-ce92-4e30-be32-5f3446a83965]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:20 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 Jul 28 16:37:20 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:20 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" returned: 0 in 0.415s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:20 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 1G Jul 28 16:37:20 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:21 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 1G" returned: 0 in 0.500s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:21 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 Jul 28 16:37:21 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:21 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" returned: 0 in 0.373s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:21 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 is being set with open permissions: ugo+rw Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:21 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 Jul 28 16:37:21 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:21 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" returned: 0 in 0.298s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:21 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.info Jul 28 16:37:21 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Flow 'volume_create_manager' (48d6072b-5ce9-427c-84a1-cefb6f7ba4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5161197d-a8c5-4de8-9a89-15aa74ee3b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5161197d-a8c5-4de8-9a89-15aa74ee3b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1279850614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da1a3ba-b11b-4daf-ad7f-922175aa9f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69017553c1dd4dd0aea2b3c9b249e859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:22Z,use_quota=True,user_id='8b4afa7aff2449c3b7dab65f90f5e7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af356ed-6e57-4f5c-a1dd-4d271f7826ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af356ed-6e57-4f5c-a1dd-4d271f7826ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4863ca3c-b751-4ff6-b1ca-15901a619ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4863ca3c-b751-4ff6-b1ca-15901a619ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da1a3ba-b11b-4daf-ad7f-922175aa9f1b', 'volume_name': 'volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c8b8ec-1e9b-45d0-b3ea-a0173c8c6674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c8b8ec-1e9b-45d0-b3ea-a0173c8c6674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ee546e-d375-4c50-b963-2901270696e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:21 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Volume 4da1a3ba-b11b-4daf-ad7f-922175aa9f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b', 'volume_size': 1} Jul 28 16:37:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:22 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.info" returned: 0 in 0.281s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:22 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.info is being set with open permissions: ugo+rw Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:22 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.info Jul 28 16:37:22 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:22 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.info" returned: 0 in 0.250s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1279850614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da1a3ba-b11b-4daf-ad7f-922175aa9f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69017553c1dd4dd0aea2b3c9b249e859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:22Z,use_quota=True,user_id='8b4afa7aff2449c3b7dab65f90f5e7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Creating volume 4da1a3ba-b11b-4daf-ad7f-922175aa9f1b {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:37:22 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:22 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b 1073741824 Jul 28 16:37:22 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ae4ff23a-c4f7-4440-904d-d84e83fa4d03 tempest-CinderUnicodeTest-228229012 None] Create snapshot completed successfully Jul 28 16:37:22 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b 1073741824" returned: 0 in 0.516s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:22 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b Jul 28 16:37:22 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:23 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b" returned: 0 in 0.266s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ee546e-d375-4c50-b963-2901270696e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93abe5df-06be-43c7-b5b8-3de3c04f4139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:23 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Volume volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b (4da1a3ba-b11b-4daf-ad7f-922175aa9f1b): created successfully Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93abe5df-06be-43c7-b5b8-3de3c04f4139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Flow 'volume_create_manager' (48d6072b-5ce9-427c-84a1-cefb6f7ba4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2b9fa553-b9d8-4c40-936e-d15d970023cc tempest-VolumeQuotasNegativeTestJSON-9674122 None] Created volume successfully. Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "cinder-3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "cinder-quobyte-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "cinder-quobyte-3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Deleting offline snapshot 3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 of volume 8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] snapshot_file for this snap is: volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc6026f-a480-40d8-a293-012f29e98879]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:23 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 Jul 28 16:37:23 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:23 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" returned: 0 in 0.399s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8191bb3f-820a-4bd8-b6e8-76280d5832bd]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:23 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 Jul 28 16:37:23 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:24 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" returned: 0 in 0.436s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:24 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 Jul 28 16:37:24 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:24 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:24 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009 Jul 28 16:37:24 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:24 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1.3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" returned: 0 in 0.294s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009" released by "_delete_snapshot" :: held 1.668s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" released by "delete_snapshot" :: held 1.697s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Acquiring lock "cinder-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "cinder-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Created reservations ['23f96b3f-dd4f-476e-8b47-bc203e781e56', '579159cd-5129-40a5-a41d-966fbc30b6de', '45cb41c9-7490-474c-bdcc-8bc9eb0b99d6', '3f2a009d-b62e-471f-895a-78b9154d87b2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Acquiring lock "cinder-quobyte-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "cinder-quobyte-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8748453-45b9-45cc-88ed-9856e088179e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Delete snapshot completed successfully. Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-20adebc6-7dd4-46c3-8848-c156b8f10907 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-3bf2fe16-ae1c-4a75-9a4f-f58fbca9c009-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:25 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b Jul 28 16:37:25 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Acquiring lock "cinder-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Lock "cinder-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Acquiring lock "cinder-quobyte-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b131ed5f-6f60-4ef4-83fd-52948542d867]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:25 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b" returned: 0 in 0.443s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:25 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b Jul 28 16:37:25 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:25 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 Jul 28 16:37:25 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:25 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b" returned: 0 in 0.268s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "cinder-quobyte-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b" released by "delete_volume" :: held 0.769s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Created reservations ['1ba2e928-aeb2-49b5-85f6-c57efdcfc652', '4229513c-56ad-48c9-b55e-0b25efec6368', 'cd5b61b5-dc8e-4760-ace1-a30f0dc8c520', 'f2be2522-5aef-4382-8512-a7e0a4319a4e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:26 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" returned: 0 in 0.477s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:26 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1 Jul 28 16:37:26 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:26 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:37:26 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:26 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1" released by "delete_volume" :: held 0.875s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:26 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.299s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:37:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Deleted volume successfully. Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ff27d7ba-28ef-4db6-bbcd-cebfacef88c4 tempest-VolumeQuotasNegativeTestJSON-9674122 None] Lock "cinder-4da1a3ba-b11b-4daf-ad7f-922175aa9f1b-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Created reservations ['1ad0177a-e1b5-4dcb-8b7e-abcf26037050', '4670b905-88c0-4c54-9f0e-1947726d2f36', 'a1a6b65c-9020-4a2a-9382-fcf97f3c61e5', 'd70d3d7b-4b65-4b1b-9b82-a2c7aa4afd86'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:26 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:37:26 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "cinder-c4516058-829e-449f-b0e6-81bdf323195f-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-c4516058-829e-449f-b0e6-81bdf323195f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "cinder-quobyte-c4516058-829e-449f-b0e6-81bdf323195f" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-c4516058-829e-449f-b0e6-81bdf323195f" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee262252-001b-4dea-bda5-4e03b5548989]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:26 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.353s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:37:27 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Deleted volume successfully. Jul 28 16:37:27 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f Jul 28 16:37:27 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d7ba38c2-6257-47f1-b6c3-3641077578bb tempest-CinderUnicodeTest-228229012 None] Lock "cinder-8663b9ff-65f1-4d9c-b8ec-956ca59bb2c1-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:27 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f" returned: 0 in 0.436s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:27 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f Jul 28 16:37:27 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:27 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c4516058-829e-449f-b0e6-81bdf323195f" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-quobyte-c4516058-829e-449f-b0e6-81bdf323195f" released by "delete_volume" :: held 0.821s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Created reservations ['99535b6a-f0ef-40b8-a7a7-9662f8b8f661', '948cc15d-7b01-4099-8c02-5e1694dba4d9', 'e3536ad0-975c-4792-9863-f42af7214e64', '527b01a7-7177-4874-8220-a3b10223a177'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:27 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:37:27 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:28 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.314s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:28 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:37:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Deleted volume successfully. Jul 28 16:37:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-4f136298-afe5-474e-add1-21e99cdbbec8 tempest-CinderUnicodeTest-228229012 None] Lock "cinder-c4516058-829e-449f-b0e6-81bdf323195f-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:37 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=136,cinder:UPDATE=198,cinder:INSERT=55,cinder:DELETE=13 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:37:38 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=164,cinder:SELECT=121,cinder:INSERT=42,cinder:DELETE=12 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Flow 'volume_create_manager' (bf651c48-c48d-4424-9de5-9f10b6e26c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79574273-f3d0-48f1-a413-337385160612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79574273-f3d0-48f1-a413-337385160612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-291875258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764d3068-53b5-40b6-a6fd-3b4cc59c2b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3efc1d1496744bc9052ec0cb85a78b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:39Z,use_quota=True,user_id='8c687d3887014ebaa0f1b63fe61cd3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfc2d0dd-eade-4b4c-a39d-23998d16380f),volume_type_id=bfc2d0dd-eade-4b4c-a39d-23998d16380f)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f761d2d-f432-45c1-8b8c-6e7d0ca66df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f761d2d-f432-45c1-8b8c-6e7d0ca66df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c90d586-0f18-4c2c-95d8-2475f56505a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c90d586-0f18-4c2c-95d8-2475f56505a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764d3068-53b5-40b6-a6fd-3b4cc59c2b92', 'volume_name': 'volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a540e88-77e5-4ea6-9b97-6b1635eb7323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a540e88-77e5-4ea6-9b97-6b1635eb7323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eb3c56-3002-4f3c-b26f-f673a472a046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:39 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Volume 764d3068-53b5-40b6-a6fd-3b4cc59c2b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92', 'volume_size': 1} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-291875258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764d3068-53b5-40b6-a6fd-3b4cc59c2b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3efc1d1496744bc9052ec0cb85a78b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:39Z,use_quota=True,user_id='8c687d3887014ebaa0f1b63fe61cd3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfc2d0dd-eade-4b4c-a39d-23998d16380f),volume_type_id=bfc2d0dd-eade-4b4c-a39d-23998d16380f)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Creating volume 764d3068-53b5-40b6-a6fd-3b4cc59c2b92 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:37:39 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:39 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 1073741824 Jul 28 16:37:39 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:39 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 1073741824" returned: 0 in 0.512s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:39 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 Jul 28 16:37:39 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:40 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92" returned: 0 in 0.283s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:37:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eb3c56-3002-4f3c-b26f-f673a472a046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dbe1ae-8f4a-4e4e-a233-5a7b66dfb074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:40 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Volume volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 (764d3068-53b5-40b6-a6fd-3b4cc59c2b92): created successfully Jul 28 16:37:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dbe1ae-8f4a-4e4e-a233-5a7b66dfb074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Flow 'volume_create_manager' (bf651c48-c48d-4424-9de5-9f10b6e26c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:40 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-85553537-41c6-4cae-93d1-be3715f40f94 tempest-VolumeTypesAccessTest-1298088583 None] Created volume successfully. Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:41 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:37:41 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:41 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.315s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Acquiring lock "cinder-764d3068-53b5-40b6-a6fd-3b4cc59c2b92-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Lock "cinder-764d3068-53b5-40b6-a6fd-3b4cc59c2b92-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Acquiring lock "cinder-quobyte-764d3068-53b5-40b6-a6fd-3b4cc59c2b92" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Lock "cinder-quobyte-764d3068-53b5-40b6-a6fd-3b4cc59c2b92" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09ed09-cdcf-4cf1-8be2-7fe0798f9c2d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:41 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 Jul 28 16:37:41 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:41 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92" returned: 0 in 0.406s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:42 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92 Jul 28 16:37:42 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:42 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-764d3068-53b5-40b6-a6fd-3b4cc59c2b92" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Lock "cinder-quobyte-764d3068-53b5-40b6-a6fd-3b4cc59c2b92" released by "delete_volume" :: held 0.732s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:42 devstack cinder-volume[88286]: WARNING cinder.quota [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-619051195 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-619051195, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:37:42 devstack cinder-volume[88286]: WARNING cinder.quota [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-619051195 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-619051195, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Created reservations ['8c7e5e44-2a46-4533-8612-c1170fe37ddf', '58894838-c7cd-4336-a9cf-c0e6841f996b', '645a324d-0ee4-4083-88b4-7a810cbc084a', '33ba3bdb-304b-4141-9327-53e2954df66d'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:42 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:37:42 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:42 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.465s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:37:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Deleted volume successfully. Jul 28 16:37:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f085d5a2-34d2-438e-9377-35bb6a417e93 tempest-VolumeTypesAccessTest-1298088583 None] Lock "cinder-764d3068-53b5-40b6-a6fd-3b4cc59c2b92-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:49 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:37:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Flow 'volume_create_manager' (f0cff54b-8714-4eeb-a7a6-e8c203fe9c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ac7c1b-bed9-438e-a1ef-13f327f58a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ac7c1b-bed9-438e-a1ef-13f327f58a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1328824280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4b520b-d50d-42c6-b638-15bd59b1164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd2b45d39de4b779a7e752157833134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:50Z,use_quota=True,user_id='a7d8e6e750d445b9801fc17d8d9787bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb130b58-6066-4ec6-8e11-e8d1560e0c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb130b58-6066-4ec6-8e11-e8d1560e0c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f97e338-c859-4245-866d-4a859850259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f97e338-c859-4245-866d-4a859850259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4b520b-d50d-42c6-b638-15bd59b1164c', 'volume_name': 'volume-ad4b520b-d50d-42c6-b638-15bd59b1164c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6e7988-6a02-41ce-8ce7-d07d6e0ff3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6e7988-6a02-41ce-8ce7-d07d6e0ff3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b7d52c-1f72-4e76-93a2-c5025acdde67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Volume ad4b520b-d50d-42c6-b638-15bd59b1164c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4b520b-d50d-42c6-b638-15bd59b1164c', 'volume_size': 1} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1328824280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4b520b-d50d-42c6-b638-15bd59b1164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd2b45d39de4b779a7e752157833134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:37:50Z,use_quota=True,user_id='a7d8e6e750d445b9801fc17d8d9787bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Creating volume ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:37:50 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:50 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c 1073741824 Jul 28 16:37:50 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:50 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c 1073741824" returned: 0 in 0.528s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:50 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c Jul 28 16:37:50 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:50 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b7d52c-1f72-4e76-93a2-c5025acdde67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4b520b-d50d-42c6-b638-15bd59b1164c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4291b914-222a-422c-9a30-69f8841580ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:37:51 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Volume volume-ad4b520b-d50d-42c6-b638-15bd59b1164c (ad4b520b-d50d-42c6-b638-15bd59b1164c): created successfully Jul 28 16:37:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4291b914-222a-422c-9a30-69f8841580ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:37:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Flow 'volume_create_manager' (f0cff54b-8714-4eeb-a7a6-e8c203fe9c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:37:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fed283a8-cfa5-4509-beab-71be463b9e5a tempest-SnapshotMetadataTestJSON-1549803103 None] Created volume successfully. Jul 28 16:37:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:37:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:37:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Creating offline snapshot 9efb522b-03fa-4e89-96e5-6f9cb4f1d074 of volume ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:37:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a8a83-a365-45fa-b287-d2ac752213ff]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:52 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c Jul 28 16:37:52 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:52 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c" returned: 0 in 0.456s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:52 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 1G Jul 28 16:37:52 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:53 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 1G" returned: 0 in 0.555s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad4b520b-d50d-42c6-b638-15bd59b1164c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:53 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad4b520b-d50d-42c6-b638-15bd59b1164c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 Jul 28 16:37:53 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:53 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad4b520b-d50d-42c6-b638-15bd59b1164c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074" returned: 0 in 0.355s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:53 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 is being set with open permissions: ugo+rw Jul 28 16:37:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:53 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 Jul 28 16:37:53 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:54 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:54 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.info Jul 28 16:37:54 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:54 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.info" returned: 0 in 0.269s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:54 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.info is being set with open permissions: ugo+rw Jul 28 16:37:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:54 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.info Jul 28 16:37:54 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:54 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.info" returned: 0 in 0.340s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:37:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-be6083da-56f6-44a8-9038-758cba480eb2 tempest-SnapshotMetadataTestJSON-1549803103 None] Create snapshot completed successfully Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "cinder-9efb522b-03fa-4e89-96e5-6f9cb4f1d074-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-9efb522b-03fa-4e89-96e5-6f9cb4f1d074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "cinder-quobyte-ad4b520b-d50d-42c6-b638-15bd59b1164c" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-quobyte-ad4b520b-d50d-42c6-b638-15bd59b1164c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "cinder-quobyte-9efb522b-03fa-4e89-96e5-6f9cb4f1d074" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-quobyte-9efb522b-03fa-4e89-96e5-6f9cb4f1d074" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Deleting offline snapshot 9efb522b-03fa-4e89-96e5-6f9cb4f1d074 of volume ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] snapshot_file for this snap is: volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5714bc48-589c-4565-a439-d00a8de9fe23]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:57 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 Jul 28 16:37:57 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:57 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074" returned: 0 in 0.448s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad4b520b-d50d-42c6-b638-15bd59b1164c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:37:57 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8303b4-6687-45c1-a916-84a834ac1d38]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:57 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c Jul 28 16:37:57 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:57 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c" returned: 0 in 0.438s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:57 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 Jul 28 16:37:57 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:58 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:58 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074 Jul 28 16:37:58 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:58 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c.9efb522b-03fa-4e89-96e5-6f9cb4f1d074" returned: 0 in 0.297s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-quobyte-9efb522b-03fa-4e89-96e5-6f9cb4f1d074" released by "_delete_snapshot" :: held 1.748s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-quobyte-ad4b520b-d50d-42c6-b638-15bd59b1164c" released by "delete_snapshot" :: held 1.776s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:58 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Created reservations ['66d1e727-d858-4ae3-bc87-3af2880fda81', '99c1628c-5655-48f4-a1e1-e53bb9403c13', '9b35f339-9f35-4d50-8329-98168eff21b9', '6f3d5056-4205-4e9b-9a4b-5a928fade624'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:37:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Delete snapshot completed successfully. Jul 28 16:37:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9b4d7a0-80a5-44e3-a18d-bffa0bc19ace tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-9efb522b-03fa-4e89-96e5-6f9cb4f1d074-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "cinder-ad4b520b-d50d-42c6-b638-15bd59b1164c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-ad4b520b-d50d-42c6-b638-15bd59b1164c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "cinder-quobyte-ad4b520b-d50d-42c6-b638-15bd59b1164c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-quobyte-ad4b520b-d50d-42c6-b638-15bd59b1164c" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe65465c-1759-4b92-8c67-baee52b879de]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:59 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c Jul 28 16:37:59 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:59 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c" returned: 0 in 0.440s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:37:59 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c Jul 28 16:37:59 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:37:59 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ad4b520b-d50d-42c6-b638-15bd59b1164c" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:37:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-quobyte-ad4b520b-d50d-42c6-b638-15bd59b1164c" released by "delete_volume" :: held 0.839s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Created reservations ['b8a93012-752f-4e0f-825f-93d642025b6b', 'ca1729ad-3806-4a28-95cf-a423d2f9d0e2', '0224c77a-0d2b-451c-b868-976da70129dc', '02b45e42-9796-4c4b-af18-b3aaa4034cf1'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:00 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:00 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:00 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.374s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Deleted volume successfully. Jul 28 16:38:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc46e194-dcbf-426f-a3ca-9e7a06c25f26 tempest-SnapshotMetadataTestJSON-1549803103 None] Lock "cinder-ad4b520b-d50d-42c6-b638-15bd59b1164c-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Flow 'volume_create_manager' (b785bf4c-f256-444f-a904-4dc63572f0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a0eae6-3803-4032-bf66-861b6c63debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a0eae6-3803-4032-bf66-861b6c63debe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1139845037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdff437-f559-4d1a-975f-4a0b1c7dd7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c1274181e94388ab99d783548afeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:04Z,use_quota=True,user_id='4854dd98e96246c1b3d964951c60b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9006e768-9c38-4a93-a5aa-1bfde87f85c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9006e768-9c38-4a93-a5aa-1bfde87f85c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1def9a12-f112-4bb4-b4f6-c5105c7f7be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1def9a12-f112-4bb4-b4f6-c5105c7f7be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdff437-f559-4d1a-975f-4a0b1c7dd7f1', 'volume_name': 'volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98e017a-b58c-41d2-aafe-3491337c791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98e017a-b58c-41d2-aafe-3491337c791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb53d207-e470-46ef-8c7c-fa7f56eade4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:04 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Volume 2bdff437-f559-4d1a-975f-4a0b1c7dd7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1', 'volume_size': 1} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1139845037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdff437-f559-4d1a-975f-4a0b1c7dd7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c1274181e94388ab99d783548afeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:04Z,use_quota=True,user_id='4854dd98e96246c1b3d964951c60b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Creating volume 2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:38:04 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:04 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 1073741824 Jul 28 16:38:04 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:04 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 1073741824" returned: 0 in 0.553s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:04 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 Jul 28 16:38:04 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:05 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" returned: 0 in 0.316s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:38:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb53d207-e470-46ef-8c7c-fa7f56eade4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11230076-801f-4565-965f-880cfd67d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:05 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Volume volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 (2bdff437-f559-4d1a-975f-4a0b1c7dd7f1): created successfully Jul 28 16:38:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11230076-801f-4565-965f-880cfd67d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:05 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Flow 'volume_create_manager' (b785bf4c-f256-444f-a904-4dc63572f0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3ef8175b-07cd-4371-b0ac-e8f4c6f317a4 tempest-SnapshotDependencyTests-987675485 None] Created volume successfully. Jul 28 16:38:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Creating offline snapshot 3bda7097-0064-4040-91a5-5176bf47b22d of volume 2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:38:06 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec10531-7ba5-40fc-87ed-e2bfddefbd5e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:06 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 Jul 28 16:38:06 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:07 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" returned: 0 in 0.462s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:07 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d 1G Jul 28 16:38:07 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Flow 'volume_create_manager' (e7a3c312-3669-47cd-9b03-7734552c9d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e481e9-54a0-47ca-94f0-04ece941298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e481e9-54a0-47ca-94f0-04ece941298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-671481996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9bb524-2b4c-44de-9fa9-27340588ba4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f474d42fdf4b3386588ea1b36a2996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:07Z,use_quota=True,user_id='a7620c65f52946f9850d66dcfe6efb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd93cdd-b8ae-4399-b8fd-7ceb1091b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd93cdd-b8ae-4399-b8fd-7ceb1091b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7f4e11-0f5d-4a84-b94a-f5f112362542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7f4e11-0f5d-4a84-b94a-f5f112362542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca9bb524-2b4c-44de-9fa9-27340588ba4c', 'volume_name': 'volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5ddfcc-659d-4104-bd98-ee2955788f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5ddfcc-659d-4104-bd98-ee2955788f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fde2e2-d5ea-476c-a7f6-3ed1c7586fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:07 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Volume ca9bb524-2b4c-44de-9fa9-27340588ba4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c', 'volume_size': 1} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:07 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d 1G" returned: 0 in 0.482s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:07 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d Jul 28 16:38:07 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:07 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d" returned: 0 in 0.341s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:07 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d is being set with open permissions: ugo+rw Jul 28 16:38:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:07 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d Jul 28 16:38:07 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:08 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:08 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.info Jul 28 16:38:08 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:08 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.info" returned: 0 in 0.271s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:08 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.info is being set with open permissions: ugo+rw Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:08 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.info Jul 28 16:38:08 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:08 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.info" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-671481996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9bb524-2b4c-44de-9fa9-27340588ba4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f474d42fdf4b3386588ea1b36a2996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:07Z,use_quota=True,user_id='a7620c65f52946f9850d66dcfe6efb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Creating volume ca9bb524-2b4c-44de-9fa9-27340588ba4c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:38:08 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:38:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:08 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c 1073741824 Jul 28 16:38:08 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b544b35e-1c28-4bff-ba69-169ca1760a81 tempest-SnapshotDependencyTests-987675485 None] Create snapshot completed successfully Jul 28 16:38:09 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c 1073741824" returned: 0 in 0.506s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:09 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c Jul 28 16:38:09 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:09 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c" returned: 0 in 0.261s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fde2e2-d5ea-476c-a7f6-3ed1c7586fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd3537-8358-4371-8596-ea6fddd6d65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:09 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Volume volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c (ca9bb524-2b4c-44de-9fa9-27340588ba4c): created successfully Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd3537-8358-4371-8596-ea6fddd6d65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Flow 'volume_create_manager' (e7a3c312-3669-47cd-9b03-7734552c9d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6146b277-1904-4617-9320-0b250d7a88e1 tempest-VolumesTransfersTest-2062541791 None] Created volume successfully. Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Flow 'volume_create_manager' (5b1eb0f2-6fdb-4cd1-8008-6dfe8bf7fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587d87b3-97d7-4741-9e45-ea9a89cd1fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587d87b3-97d7-4741-9e45-ea9a89cd1fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c1274181e94388ab99d783548afeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3bda7097-0064-4040-91a5-5176bf47b22d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:10Z,use_quota=True,user_id='4854dd98e96246c1b3d964951c60b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65fd233-6e19-4707-bf77-4b22c7873b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65fd233-6e19-4707-bf77-4b22c7873b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b34538-1657-4393-a626-7f10e65e38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b34538-1657-4393-a626-7f10e65e38e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd', 'volume_name': 'volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd', 'volume_size': 1, 'snapshot_id': '3bda7097-0064-4040-91a5-5176bf47b22d'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb59a84-82cc-4cda-b19b-85b621cdb3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb59a84-82cc-4cda-b19b-85b621cdb3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4ed79f-012c-4019-b45d-e9d911dceec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Volume 2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd', 'volume_size': 1, 'snapshot_id': '3bda7097-0064-4040-91a5-5176bf47b22d'} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-quobyte-3bda7097-0064-4040-91a5-5176bf47b22d-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-3bda7097-0064-4040-91a5-5176bf47b22d-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Creating volume 2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd from snapshot 3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-quobyte-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] snapshot: 3bda7097-0064-4040-91a5-5176bf47b22d, volume: 2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e260ce-42eb-4ffe-8346-e402612603a6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:10 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d Jul 28 16:38:10 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:11 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d" returned: 0 in 0.474s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:38:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c8c5edaa-8294-434f-9238-035c4402d419 tempest-VolumesTransfersTest-234812637 None] Transfer volume completed successfully. Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8404c9d5-b387-49a8-98fa-2f6f807a82c4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:11 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 Jul 28 16:38:11 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:11 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" returned: 0 in 0.512s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:11 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd Jul 28 16:38:11 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Acquiring lock "cinder-ca9bb524-2b4c-44de-9fa9-27340588ba4c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-ca9bb524-2b4c-44de-9fa9-27340588ba4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Acquiring lock "cinder-quobyte-ca9bb524-2b4c-44de-9fa9-27340588ba4c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-quobyte-ca9bb524-2b4c-44de-9fa9-27340588ba4c" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:12 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd700517-fda7-472c-9923-16475311eecd]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:12 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c Jul 28 16:38:12 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:12 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c" returned: 0 in 0.547s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:12 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c Jul 28 16:38:12 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:13 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ca9bb524-2b4c-44de-9fa9-27340588ba4c" returned: 0 in 0.467s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-quobyte-ca9bb524-2b4c-44de-9fa9-27340588ba4c" released by "delete_volume" :: held 1.082s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Created reservations ['319a45dc-f6b4-4551-882f-17346aec7d0d', 'fa696804-d80c-4b95-9477-948a7218be4d', '7f74d527-a705-4ed7-bf7b-318af829f45e', 'bbf407d0-a7fd-4bd4-8bca-40b9b6abcabf'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:13 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:13 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:14 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.701s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:14 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Deleted volume successfully. Jul 28 16:38:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-01a800d1-88af-4c30-bd27-a9fce0b27ef4 tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-ca9bb524-2b4c-44de-9fa9-27340588ba4c-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Flow 'volume_create_manager' (3d196668-89c0-4f2e-9368-6ad6c3ce8d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9949efee-82c3-4b64-b582-a2822503f57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9949efee-82c3-4b64-b582-a2822503f57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1794424220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f474d42fdf4b3386588ea1b36a2996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:16Z,use_quota=True,user_id='a7620c65f52946f9850d66dcfe6efb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2e5ec3-78c7-4bc2-bdbd-42adbb6e1a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2e5ec3-78c7-4bc2-bdbd-42adbb6e1a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed1a6e2-ed75-4a29-80ea-e56ceb7ddd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed1a6e2-ed75-4a29-80ea-e56ceb7ddd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18', 'volume_name': 'volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f431cd4-5cf0-4dd9-8f1e-70584a8119b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f431cd4-5cf0-4dd9-8f1e-70584a8119b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24823a7b-af86-4150-b0ce-8c867e527d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Volume 1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18', 'volume_size': 1} Jul 28 16:38:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:16 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" returned: 0 in 5.146s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:16 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b53157-ef21-4c33-98af-bfc034fb9d12]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:17 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 Jul 28 16:38:17 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:17 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" returned: 0 in 0.580s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:38:17 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Converted 1024.00 MB image at 198.93 MB/s Jul 28 16:38:17 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd is being set with open permissions: ugo+rw Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:17 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd Jul 28 16:38:17 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:17 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" returned: 0 in 0.273s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" released by "_copy_volume_from_snapshot" :: held 7.263s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-3bda7097-0064-4040-91a5-5176bf47b22d-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" released by "_create_volume_from_snapshot" :: held 7.303s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.330s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1794424220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f474d42fdf4b3386588ea1b36a2996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:16Z,use_quota=True,user_id='a7620c65f52946f9850d66dcfe6efb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Creating volume 1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:38:17 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:17 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 1073741824 Jul 28 16:38:17 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4ed79f-012c-4019-b45d-e9d911dceec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd', 'volume_size': 1, 'snapshot_id': '3bda7097-0064-4040-91a5-5176bf47b22d'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82436748-0f93-43b1-baac-883d1ac05a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:17 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Volume volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd (2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd): created successfully Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82436748-0f93-43b1-baac-883d1ac05a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Flow 'volume_create_manager' (5b1eb0f2-6fdb-4cd1-8008-6dfe8bf7fc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0eca26a9-d1bb-49f0-9ca4-9a7278c9c127 tempest-SnapshotDependencyTests-987675485 None] Created volume successfully. Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-3bda7097-0064-4040-91a5-5176bf47b22d-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-3bda7097-0064-4040-91a5-5176bf47b22d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-quobyte-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-quobyte-3bda7097-0064-4040-91a5-5176bf47b22d" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-3bda7097-0064-4040-91a5-5176bf47b22d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Deleting offline snapshot 3bda7097-0064-4040-91a5-5176bf47b22d of volume 2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:38:18 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] snapshot_file for this snap is: volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 1073741824" returned: 0 in 0.555s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d1ba03-3e06-4377-b4d3-9f92a0907067]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:18 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 Jul 28 16:38:18 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:18 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d Jul 28 16:38:18 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:18 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18" returned: 0 in 0.339s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24823a7b-af86-4150-b0ce-8c867e527d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509e2701-f91b-4b46-96e8-b478420c0bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:18 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Volume volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 (1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18): created successfully Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509e2701-f91b-4b46-96e8-b478420c0bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Flow 'volume_create_manager' (3d196668-89c0-4f2e-9368-6ad6c3ce8d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:18 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d" returned: 0 in 0.465s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:38:18 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-00c75df5-60e2-411a-83bb-1e41790f78c2 tempest-VolumesTransfersTest-2062541791 None] Created volume successfully. Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afafcfc-7ecd-4322-ae25-c09e71f694a7]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:19 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 Jul 28 16:38:19 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:19 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" returned: 0 in 0.414s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:19 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d Jul 28 16:38:19 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:19 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d" returned: 0 in 0.394s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:19 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d Jul 28 16:38:19 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:20 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1.3bda7097-0064-4040-91a5-5176bf47b22d" returned: 0 in 0.286s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Acquiring lock "cinder-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-3bda7097-0064-4040-91a5-5176bf47b22d" released by "_delete_snapshot" :: held 1.700s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" released by "delete_snapshot" :: held 1.729s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Acquiring lock "cinder-quobyte-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-quobyte-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cfd618-eaae-4bd6-81b5-daac23c600cb]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Created reservations ['47e1e647-db57-480c-aa2b-9bd981689307', '0f33e603-1bbb-4813-ad03-d5387d194ece', '5ce01963-695e-4870-9815-5a61387e56c2', '3c278739-b28b-42ce-b376-03be22b7ed80'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Delete snapshot completed successfully. Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10b91d8a-fc80-40bf-85b7-21bb9fd90679 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-3bda7097-0064-4040-91a5-5176bf47b22d-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:20 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 Jul 28 16:38:20 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-quobyte-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[71092284-fa38-49e2-b5c5-5e37c51bae9a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:20 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18" returned: 0 in 0.484s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:20 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18 Jul 28 16:38:20 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:20 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 Jul 28 16:38:20 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:20 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18" returned: 0 in 0.296s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-quobyte-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18" released by "delete_volume" :: held 0.825s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Created reservations ['6d2d02f9-f473-44aa-84e3-436ee85744f7', '49c5d943-e53a-47c3-a0fb-118e932a3755', 'a4696e3b-ae17-4e9a-a7cb-43e6180599a9', 'bb56816a-df46-4748-b368-387598f2fbd8'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:21 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" returned: 0 in 0.431s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:21 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1 Jul 28 16:38:21 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:21 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:21 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:21 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" returned: 0 in 0.364s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1" released by "delete_volume" :: held 0.883s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:21 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.371s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:21 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Deleted volume successfully. Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Created reservations ['f900d65a-87e7-43dd-8da9-fa84f69ee91e', 'bfafd077-70ae-464e-891b-eb90711d5fca', '4e8e0ee3-f458-475a-a927-116088db97be', 'cb3a85d1-43c0-4d5b-8bfc-ad188b26d3d7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9e1bcd59-860d-4322-b2e0-749635a36d3a tempest-VolumesTransfersTest-1429501232 None] Lock "cinder-1ac829bb-b3ba-4cb8-9bb4-e46fadaa5e18-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:21 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:21 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:22 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.319s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:22 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Deleted volume successfully. Jul 28 16:38:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b9d33a6d-7c19-4ae7-9d89-7f0992aa3a98 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-2bdff437-f559-4d1a-975f-4a0b1c7dd7f1-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "cinder-quobyte-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471d61a-da8c-4268-aa59-5ab006033f4c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:23 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd Jul 28 16:38:23 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:23 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" returned: 0 in 0.419s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:23 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd Jul 28 16:38:23 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:23 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-quobyte-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd" released by "delete_volume" :: held 0.782s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Created reservations ['886fae87-b5d0-4b91-bf2c-890026c42ef0', '9642d5a8-a012-42bd-81a4-fec0702e8264', '27faca19-511b-4c0c-a997-78397f8c0cd0', '1dbcb82f-fb50-4fa3-a526-b95d9fc3a952'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:23 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:23 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:24 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:24 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Deleted volume successfully. Jul 28 16:38:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-83e29886-ddd2-430d-909f-4f93b718ef15 tempest-SnapshotDependencyTests-987675485 None] Lock "cinder-2e18c85d-06b4-4daa-8585-7e3dfbb9c1bd-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Flow 'volume_create_manager' (5307b2ad-01c3-41d8-a23a-4237755c0fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41007c8-d964-4204-b950-7129fa841401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41007c8-d964-4204-b950-7129fa841401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-397787183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab08847-0f33-4d09-8943-306f0871bf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d9cd113eb24dd0b400993f0750432a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:30Z,use_quota=True,user_id='a3717e1b5f2a40ceb267cec1c236b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97657391-6b69-4204-8ca2-9bb8c3b49d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97657391-6b69-4204-8ca2-9bb8c3b49d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51573c4a-a5e5-4def-97bd-704ab9c516c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51573c4a-a5e5-4def-97bd-704ab9c516c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab08847-0f33-4d09-8943-306f0871bf50', 'volume_name': 'volume-0ab08847-0f33-4d09-8943-306f0871bf50', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b0efec-ced2-4904-aab8-92db264fed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b0efec-ced2-4904-aab8-92db264fed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432b2a71-878e-4e30-a70b-14f31e5525e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:30 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Volume 0ab08847-0f33-4d09-8943-306f0871bf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab08847-0f33-4d09-8943-306f0871bf50', 'volume_size': 1} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-397787183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab08847-0f33-4d09-8943-306f0871bf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d9cd113eb24dd0b400993f0750432a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:30Z,use_quota=True,user_id='a3717e1b5f2a40ceb267cec1c236b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Creating volume 0ab08847-0f33-4d09-8943-306f0871bf50 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:38:30 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:30 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 1073741824 Jul 28 16:38:30 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:30 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 1073741824" returned: 0 in 0.554s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:30 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 Jul 28 16:38:30 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:31 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:38:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432b2a71-878e-4e30-a70b-14f31e5525e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab08847-0f33-4d09-8943-306f0871bf50', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadd46c2-6cd6-4210-8afd-1f2555dd9b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:31 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Volume volume-0ab08847-0f33-4d09-8943-306f0871bf50 (0ab08847-0f33-4d09-8943-306f0871bf50): created successfully Jul 28 16:38:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadd46c2-6cd6-4210-8afd-1f2555dd9b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:31 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Flow 'volume_create_manager' (5307b2ad-01c3-41d8-a23a-4237755c0fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:31 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-37c88b5f-7a6e-407e-b7bc-ea4ce8f5e218 tempest-VolumesTransfersV355Test-566688993 None] Created volume successfully. Jul 28 16:38:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-62f33269-f9f3-4cf2-bf15-8879ee60845a tempest-VolumesTransfersV355Test-766628308 None] Transfer volume completed successfully. Jul 28 16:38:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Acquiring lock "cinder-0ab08847-0f33-4d09-8943-306f0871bf50-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-0ab08847-0f33-4d09-8943-306f0871bf50-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Acquiring lock "cinder-quobyte-0ab08847-0f33-4d09-8943-306f0871bf50" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-quobyte-0ab08847-0f33-4d09-8943-306f0871bf50" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee2dc04-151e-4b9e-ba04-04a78368b61a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:34 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 Jul 28 16:38:34 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:34 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50" returned: 0 in 0.491s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:34 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50 Jul 28 16:38:34 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:34 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0ab08847-0f33-4d09-8943-306f0871bf50" returned: 0 in 0.328s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-quobyte-0ab08847-0f33-4d09-8943-306f0871bf50" released by "delete_volume" :: held 0.886s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Created reservations ['8b2a5895-a44f-4eb3-82b3-ae59799e63dc', 'a9128da1-9c3d-43a9-ab3b-8704b917c29e', 'a4fdb833-0b7e-4793-ac62-8b3856df3926', '6972b179-f89a-4a28-adc2-434f13bdef84'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:35 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:35 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:35 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Deleted volume successfully. Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-54ad3ab0-046c-4ac4-b621-9abe17a85635 tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-0ab08847-0f33-4d09-8943-306f0871bf50-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Flow 'volume_create_manager' (dc3aadab-b0b0-433d-9215-3d46ba70424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4efdee-ad45-4cf3-876a-c7db93a4e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4efdee-ad45-4cf3-876a-c7db93a4e28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-582351604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0822fde7-5c20-4a01-b797-b3457603457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d9cd113eb24dd0b400993f0750432a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:36Z,use_quota=True,user_id='a3717e1b5f2a40ceb267cec1c236b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ef189e-1f92-47c1-ac14-031b32778067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ef189e-1f92-47c1-ac14-031b32778067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1847e44-efb7-4e10-adc9-8b3fc9595ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1847e44-efb7-4e10-adc9-8b3fc9595ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0822fde7-5c20-4a01-b797-b3457603457b', 'volume_name': 'volume-0822fde7-5c20-4a01-b797-b3457603457b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a01bf4d-b606-4eb7-b5ab-66f3391543d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a01bf4d-b606-4eb7-b5ab-66f3391543d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc53660-95a5-49e6-9e1b-58c956a10cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:35 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Volume 0822fde7-5c20-4a01-b797-b3457603457b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0822fde7-5c20-4a01-b797-b3457603457b', 'volume_size': 1} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-582351604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0822fde7-5c20-4a01-b797-b3457603457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d9cd113eb24dd0b400993f0750432a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:36Z,use_quota=True,user_id='a3717e1b5f2a40ceb267cec1c236b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Creating volume 0822fde7-5c20-4a01-b797-b3457603457b {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:38:35 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:38:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:35 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b 1073741824 Jul 28 16:38:35 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:36 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b 1073741824" returned: 0 in 0.490s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:36 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b Jul 28 16:38:36 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:36 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b" returned: 0 in 0.280s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc53660-95a5-49e6-9e1b-58c956a10cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0822fde7-5c20-4a01-b797-b3457603457b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59823273-797a-49aa-8fa7-52e292abcfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:36 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Volume volume-0822fde7-5c20-4a01-b797-b3457603457b (0822fde7-5c20-4a01-b797-b3457603457b): created successfully Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59823273-797a-49aa-8fa7-52e292abcfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:36 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Flow 'volume_create_manager' (dc3aadab-b0b0-433d-9215-3d46ba70424e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-872d82c8-33c2-4a78-b49a-d51aec2802fc tempest-VolumesTransfersV355Test-566688993 None] Created volume successfully. Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Acquiring lock "cinder-0822fde7-5c20-4a01-b797-b3457603457b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-0822fde7-5c20-4a01-b797-b3457603457b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=95,cinder:INSERT=21,cinder:SELECT=67,cinder:DELETE=9 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Acquiring lock "cinder-quobyte-0822fde7-5c20-4a01-b797-b3457603457b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-quobyte-0822fde7-5c20-4a01-b797-b3457603457b" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaa814e-dd62-459b-b34b-e70a82d8a938]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:38 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b Jul 28 16:38:38 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:38 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b" returned: 0 in 0.417s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:38 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b Jul 28 16:38:38 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:38 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0822fde7-5c20-4a01-b797-b3457603457b" returned: 0 in 0.273s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-quobyte-0822fde7-5c20-4a01-b797-b3457603457b" released by "delete_volume" :: held 0.739s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:38 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=78,cinder:UPDATE=93,cinder:DELETE=8,cinder:INSERT=24 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Created reservations ['21ed05ba-6659-4728-a3cc-a37c55fd958c', '7f8d891a-2886-430a-89da-0c252fb82f7f', '45b6661f-95f0-443f-9761-e6023cf62afa', '9d0e6657-44e2-4409-9466-a51988ec64ad'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:39 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:39 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:39 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.323s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:39 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Deleted volume successfully. Jul 28 16:38:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-03edf0d6-e298-4c80-bb44-659e52bca2be tempest-VolumesTransfersV355Test-1484772605 None] Lock "cinder-0822fde7-5c20-4a01-b797-b3457603457b-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:41 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:38:41 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:41 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.288s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:38:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Flow 'volume_create_manager' (c3e7f630-fce3-4d11-bf9f-03acf58f6bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a500f9c-3b62-4d23-9040-d92c23a0eb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a500f9c-3b62-4d23-9040-d92c23a0eb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-476813519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c027d108-7733-4e8a-a2a1-5ed493c5012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace049ec12804deaaa5a679a53b6d12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:45Z,use_quota=True,user_id='b19b8adcfc94437fac8acf2396bfac16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36dd52b-5255-4e71-8d3f-c3eb7a1b9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36dd52b-5255-4e71-8d3f-c3eb7a1b9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda8e99b-1db5-4fa5-810e-2f9194704a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda8e99b-1db5-4fa5-810e-2f9194704a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c027d108-7733-4e8a-a2a1-5ed493c5012e', 'volume_name': 'volume-c027d108-7733-4e8a-a2a1-5ed493c5012e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ae0828-903a-43be-963b-ecef8c63b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ae0828-903a-43be-963b-ecef8c63b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43616520-f7b2-4179-932e-b327467663c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Volume c027d108-7733-4e8a-a2a1-5ed493c5012e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c027d108-7733-4e8a-a2a1-5ed493c5012e', 'volume_size': 1} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-476813519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c027d108-7733-4e8a-a2a1-5ed493c5012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace049ec12804deaaa5a679a53b6d12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:38:45Z,use_quota=True,user_id='b19b8adcfc94437fac8acf2396bfac16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Creating volume c027d108-7733-4e8a-a2a1-5ed493c5012e {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:38:45 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:38:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:45 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e 1073741824 Jul 28 16:38:45 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:46 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e 1073741824" returned: 0 in 0.504s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:38:46 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e Jul 28 16:38:46 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:38:46 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e" returned: 0 in 0.301s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43616520-f7b2-4179-932e-b327467663c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c027d108-7733-4e8a-a2a1-5ed493c5012e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2ea440-3488-43cf-8602-b64925d5785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:38:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Volume volume-c027d108-7733-4e8a-a2a1-5ed493c5012e (c027d108-7733-4e8a-a2a1-5ed493c5012e): created successfully Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2ea440-3488-43cf-8602-b64925d5785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:38:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Flow 'volume_create_manager' (c3e7f630-fce3-4d11-bf9f-03acf58f6bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:38:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8d815e90-a82c-4642-a43f-0c56ea9c78d8 tempest-VolumesNegativeTest-305098789 None] Created volume successfully. Jul 28 16:38:56 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:INSERT=2,cinder:UPDATE=13,cinder:SELECT=4 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:38:56 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Acquiring lock "cinder-c027d108-7733-4e8a-a2a1-5ed493c5012e-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Lock "cinder-c027d108-7733-4e8a-a2a1-5ed493c5012e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Acquiring lock "cinder-quobyte-c027d108-7733-4e8a-a2a1-5ed493c5012e" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Lock "cinder-quobyte-c027d108-7733-4e8a-a2a1-5ed493c5012e" acquired by "delete_volume" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce2701f-758f-4696-b0dc-9defbc8a5e25]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:39:07 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e Jul 28 16:39:07 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:39:07 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e" returned: 0 in 0.376s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:39:07 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e Jul 28 16:39:07 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:39:07 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c027d108-7733-4e8a-a2a1-5ed493c5012e" returned: 0 in 0.266s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:39:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Lock "cinder-quobyte-c027d108-7733-4e8a-a2a1-5ed493c5012e" released by "delete_volume" :: held 0.683s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Created reservations ['4a45bb09-d053-4879-b312-de738fb89037', '4b0b6083-8f5c-4430-bf26-a95c8a7ac3f1', '4c903741-c25b-4902-9c7f-90c2a8153d58', 'ca82147d-ae1b-4d70-b142-5ed31aed59d7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:39:08 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:39:08 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:39:08 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.274s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:39:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Deleted volume successfully. Jul 28 16:39:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2064c860-7b56-4366-b93a-39376543a14d tempest-VolumesNegativeTest-305098789 None] Lock "cinder-c027d108-7733-4e8a-a2a1-5ed493c5012e-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:39:18 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:39:18 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:39:41 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:39:41 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:39:41 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:39:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Flow 'volume_create_manager' (134e9e2f-a9ea-4f19-b7ae-113f17b0fe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a077d441-f539-4bcf-aa0c-ecbcb5a4e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a077d441-f539-4bcf-aa0c-ecbcb5a4e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1817673773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7613dd86-f35e-4e04-aefe-b05777cbdb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9977cbc895704c1f8880a241cd064261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:39:44Z,use_quota=True,user_id='c9b3426cba334acda1f2b2a487d9026c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c383c5d-f55a-4fbc-a297-eb542b2f2ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c383c5d-f55a-4fbc-a297-eb542b2f2ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc2b7b9-69df-4540-9cc7-31d7f44481fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc2b7b9-69df-4540-9cc7-31d7f44481fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7613dd86-f35e-4e04-aefe-b05777cbdb07', 'volume_name': 'volume-7613dd86-f35e-4e04-aefe-b05777cbdb07', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a05a9c9-cc47-4552-9c4e-803e4d1ac150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a05a9c9-cc47-4552-9c4e-803e4d1ac150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9eade2-a719-4c7b-b3ce-50542090a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:39:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Volume 7613dd86-f35e-4e04-aefe-b05777cbdb07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7613dd86-f35e-4e04-aefe-b05777cbdb07', 'volume_size': 1} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1817673773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7613dd86-f35e-4e04-aefe-b05777cbdb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9977cbc895704c1f8880a241cd064261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:39:44Z,use_quota=True,user_id='c9b3426cba334acda1f2b2a487d9026c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Creating volume 7613dd86-f35e-4e04-aefe-b05777cbdb07 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:39:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:39:44 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 1073741824 Jul 28 16:39:44 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:39:44 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 1073741824" returned: 0 in 0.540s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:39:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:39:45 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 Jul 28 16:39:45 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:39:45 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 28 16:39:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07" returned: 0 in 0.283s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:39:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:39:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:39:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9eade2-a719-4c7b-b3ce-50542090a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7613dd86-f35e-4e04-aefe-b05777cbdb07', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:39:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1890515-c6ab-4a50-be55-533cff115750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:39:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Volume volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 (7613dd86-f35e-4e04-aefe-b05777cbdb07): created successfully Jul 28 16:39:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1890515-c6ab-4a50-be55-533cff115750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:39:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Flow 'volume_create_manager' (134e9e2f-a9ea-4f19-b7ae-113f17b0fe45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:39:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e7518d81-9e10-4430-8ec3-a97170d01434 tempest-TestMinimumBasicScenario-163340435 None] Created volume successfully. Jul 28 16:39:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-171df49d-b749-4ca4-ad4a-4b82fa09c4b3 req-200c2772-67af-41fc-8f7f-806230bd64bf tempest-TestMinimumBasicScenario-163340435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:39:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-171df49d-b749-4ca4-ad4a-4b82fa09c4b3 req-200c2772-67af-41fc-8f7f-806230bd64bf tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:39:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-171df49d-b749-4ca4-ad4a-4b82fa09c4b3 req-200c2772-67af-41fc-8f7f-806230bd64bf tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:39:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-171df49d-b749-4ca4-ad4a-4b82fa09c4b3 req-200c2772-67af-41fc-8f7f-806230bd64bf tempest-TestMinimumBasicScenario-163340435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-7613dd86-f35e-4e04-aefe-b05777cbdb07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '705bc061-825a-4bbb-a731-2726ddd5a38a', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:39:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-171df49d-b749-4ca4-ad4a-4b82fa09c4b3 req-200c2772-67af-41fc-8f7f-806230bd64bf tempest-TestMinimumBasicScenario-163340435 None] attachment_update completed successfully. Jul 28 16:39:57 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:39:57 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:40:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-d75a0066-52ea-45a4-ac1f-c5cd6b19f32b req-c1f155c3-7d0b-41e4-8483-3cadde6ed90c tempest-TestMinimumBasicScenario-163340435 None] Terminate volume connection completed successfully. Jul 28 16:40:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-d75a0066-52ea-45a4-ac1f-c5cd6b19f32b req-c1f155c3-7d0b-41e4-8483-3cadde6ed90c tempest-TestMinimumBasicScenario-163340435 None] Deleting attachment 705bc061-825a-4bbb-a731-2726ddd5a38a. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:40:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Acquiring lock "cinder-7613dd86-f35e-4e04-aefe-b05777cbdb07-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:40:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Lock "cinder-7613dd86-f35e-4e04-aefe-b05777cbdb07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:40:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Acquiring lock "cinder-quobyte-7613dd86-f35e-4e04-aefe-b05777cbdb07" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:40:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Lock "cinder-quobyte-7613dd86-f35e-4e04-aefe-b05777cbdb07" acquired by "delete_volume" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:40:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd72142-b704-4382-b44b-f7ddddbe170c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:40:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:40:34 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 Jul 28 16:40:34 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:40:35 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07" returned: 0 in 0.397s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:40:35 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07 Jul 28 16:40:35 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:40:35 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7613dd86-f35e-4e04-aefe-b05777cbdb07" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Lock "cinder-quobyte-7613dd86-f35e-4e04-aefe-b05777cbdb07" released by "delete_volume" :: held 0.723s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Created reservations ['04901fe8-f6c7-41f7-8405-9d13c0ae9496', 'ef17817f-c7a6-410a-9268-54d4177b2956', '99790adf-9e32-430d-89b1-d2c89d95374b', '3ca232d3-1a8d-4d68-b6c2-2b79ed14a710'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:40:35 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:40:35 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:40:35 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:40:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Deleted volume successfully. Jul 28 16:40:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0de9c7a6-ebb5-4bf2-8a94-5c1fa20b2206 tempest-TestMinimumBasicScenario-163340435 None] Lock "cinder-7613dd86-f35e-4e04-aefe-b05777cbdb07-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:40:41 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:40:41 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:40:41 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.303s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:40:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:40:45 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:40:45 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:41:41 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:41:41 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:41:41 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:41:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Flow 'volume_create_manager' (92fa822d-ecda-4c37-892d-85ff680e9f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e3b6b-2d94-4d2d-b633-27f7c9ab5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e3b6b-2d94-4d2d-b633-27f7c9ab5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1895735131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f756667f-44b3-49f0-9a4f-b14387b86d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0d84a5beae48989353254af2862cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:41:45Z,use_quota=True,user_id='f73f04af1b53428b9a8375ca27ca4459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b2bf33-eb74-40f6-8961-2b0ceca0e767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b2bf33-eb74-40f6-8961-2b0ceca0e767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b26809-5738-49d7-abad-9c4f72ad74b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b26809-5738-49d7-abad-9c4f72ad74b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f756667f-44b3-49f0-9a4f-b14387b86d49', 'volume_name': 'volume-f756667f-44b3-49f0-9a4f-b14387b86d49', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c2169c-e7ae-4063-879f-58ef8862b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c2169c-e7ae-4063-879f-58ef8862b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8deb35-67d5-4c38-971b-6440811e81d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:41:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Volume f756667f-44b3-49f0-9a4f-b14387b86d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f756667f-44b3-49f0-9a4f-b14387b86d49', 'volume_size': 1} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1895735131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f756667f-44b3-49f0-9a4f-b14387b86d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0d84a5beae48989353254af2862cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:41:45Z,use_quota=True,user_id='f73f04af1b53428b9a8375ca27ca4459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Creating volume f756667f-44b3-49f0-9a4f-b14387b86d49 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:41:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:41:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:41:44 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 1073741824 Jul 28 16:41:44 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:41:45 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 1073741824" returned: 0 in 0.490s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:41:45 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 Jul 28 16:41:45 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:41:45 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8deb35-67d5-4c38-971b-6440811e81d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f756667f-44b3-49f0-9a4f-b14387b86d49', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ab1cf0-5705-4edf-949c-3f18068197c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:41:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Volume volume-f756667f-44b3-49f0-9a4f-b14387b86d49 (f756667f-44b3-49f0-9a4f-b14387b86d49): created successfully Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ab1cf0-5705-4edf-949c-3f18068197c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:41:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Flow 'volume_create_manager' (92fa822d-ecda-4c37-892d-85ff680e9f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:41:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d866625e-594b-4050-bb40-a8363743ae35 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Created volume successfully. Jul 28 16:41:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-1631b0ba-2135-4ab9-8e9f-92c0eba421d3 req-e4cf8a74-ad02-4d45-a5dc-1c03c5bfe5fe tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:41:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-1631b0ba-2135-4ab9-8e9f-92c0eba421d3 req-e4cf8a74-ad02-4d45-a5dc-1c03c5bfe5fe tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:41:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [req-1631b0ba-2135-4ab9-8e9f-92c0eba421d3 req-e4cf8a74-ad02-4d45-a5dc-1c03c5bfe5fe tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:41:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-1631b0ba-2135-4ab9-8e9f-92c0eba421d3 req-e4cf8a74-ad02-4d45-a5dc-1c03c5bfe5fe tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff', 'name': 'volume-f756667f-44b3-49f0-9a4f-b14387b86d49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f783b767-56a9-44c1-a71d-0ae57ea01e80', 'enforce_multipath': True} {{(pid=88286) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 16:41:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-1631b0ba-2135-4ab9-8e9f-92c0eba421d3 req-e4cf8a74-ad02-4d45-a5dc-1c03c5bfe5fe tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] attachment_update completed successfully. Jul 28 16:41:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [req-e386e853-b221-482d-aa22-392ccd3a7df9 req-ea9b2c46-f02d-4e79-ad09-37152d3b3f26 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Terminate volume connection completed successfully. Jul 28 16:41:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [req-e386e853-b221-482d-aa22-392ccd3a7df9 req-ea9b2c46-f02d-4e79-ad09-37152d3b3f26 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Deleting attachment f783b767-56a9-44c1-a71d-0ae57ea01e80. {{(pid=88286) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 16:41:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Acquiring lock "cinder-f756667f-44b3-49f0-9a4f-b14387b86d49-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "cinder-f756667f-44b3-49f0-9a4f-b14387b86d49-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Acquiring lock "cinder-quobyte-f756667f-44b3-49f0-9a4f-b14387b86d49" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "cinder-quobyte-f756667f-44b3-49f0-9a4f-b14387b86d49" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34daced-732a-4101-92c3-9696375a92cb]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:41:52 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 Jul 28 16:41:52 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:41:52 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49" returned: 0 in 0.407s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:41:52 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49 Jul 28 16:41:52 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:41:52 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f756667f-44b3-49f0-9a4f-b14387b86d49" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "cinder-quobyte-f756667f-44b3-49f0-9a4f-b14387b86d49" released by "delete_volume" :: held 0.728s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Created reservations ['5121a43f-4f95-482d-bac9-77525a0743e2', 'b0b30c9f-bc5f-4596-9695-66cf2b4e0734', 'd2c415d4-aae7-436d-88ae-78c515d51c51', '50c9d315-37ce-4815-90d2-5a387a653c79'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:41:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:41:52 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:41:52 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:41:53 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 28 16:41:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.277s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:41:53 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:41:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Deleted volume successfully. Jul 28 16:41:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-649d4e9f-6db1-482f-9d80-f3d432d322d5 tempest-TestServerVolumeAttachScenarioOldVersion-35881433 None] Lock "cinder-f756667f-44b3-49f0-9a4f-b14387b86d49-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:02 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:INSERT=3 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:42:03 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Flow 'volume_create_manager' (a13f68f8-9e10-4318-8390-f0d23c5167be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c631fdb5-62d3-4eb8-9462-77b4c1e75dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c631fdb5-62d3-4eb8-9462-77b4c1e75dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d10ed3-9e8b-483b-a219-59c360ff875c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d719791501ea49169d7551fc50797cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:12Z,use_quota=True,user_id='a18477741e764b8eb875947671d3e61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a697a27b-a473-4410-bdf1-5fb6c5c27a4e),volume_type_id=a697a27b-a473-4410-bdf1-5fb6c5c27a4e)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60edb1a2-dcf8-48e0-8934-048b0763c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60edb1a2-dcf8-48e0-8934-048b0763c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d9ed2e-8c9e-4720-86d4-2de2b6451e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d9ed2e-8c9e-4720-86d4-2de2b6451e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9d10ed3-9e8b-483b-a219-59c360ff875c', 'volume_name': 'volume-a9d10ed3-9e8b-483b-a219-59c360ff875c', 'volume_size': 1, 'image_id': '2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8083ecc2986e6398824aa2e5d012ebc4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd719791501ea49169d7551fc50797cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '687e0dad5b3adfda340135c7c2a91f3251b1d1b92e17909e06b15a5b7406b372e4c08e4d5b617c26d3742fa003b6bd78aa496c31ce60632ecbc7162a16407204', 'id': '2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'created_at': datetime.datetime(2026, 7, 28, 14, 42, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 42, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d76371-8c43-4f68-a45a-7f793f385231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d76371-8c43-4f68-a45a-7f793f385231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a5bc81-26a7-4882-abee-ec2cbfe55773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:12 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Volume a9d10ed3-9e8b-483b-a219-59c360ff875c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9d10ed3-9e8b-483b-a219-59c360ff875c', 'volume_size': 1, 'image_id': '2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8083ecc2986e6398824aa2e5d012ebc4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd719791501ea49169d7551fc50797cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '687e0dad5b3adfda340135c7c2a91f3251b1d1b92e17909e06b15a5b7406b372e4c08e4d5b617c26d3742fa003b6bd78aa496c31ce60632ecbc7162a16407204', 'id': '2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'created_at': datetime.datetime(2026, 7, 28, 14, 42, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 42, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Trying to clone a9d10ed3-9e8b-483b-a219-59c360ff875c from image 2d01b148-95b5-41dc-9dfb-00cb3e078af4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:42:12 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Image download 0.00 MB at 0.00 MB/s Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a72c3-3714-428e-b342-87dd27defe1a]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:12 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD Jul 28 16:42:12 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:13 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:13 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD Jul 28 16:42:13 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:13 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Temporary image 2d01b148-95b5-41dc-9dfb-00cb3e078af4 is fetched for user a18477741e764b8eb875947671d3e61f. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae519438-a3d7-44ed-b2a9-19bd230ab669]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:13 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD Jul 28 16:42:13 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:13 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:14 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD Jul 28 16:42:14 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:14 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d10ed3-9e8b-483b-a219-59c360ff875c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d719791501ea49169d7551fc50797cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:12Z,use_quota=True,user_id='a18477741e764b8eb875947671d3e61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a697a27b-a473-4410-bdf1-5fb6c5c27a4e),volume_type_id=a697a27b-a473-4410-bdf1-5fb6c5c27a4e)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Creating volume a9d10ed3-9e8b-483b-a219-59c360ff875c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:14 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:14 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c 1073741824 Jul 28 16:42:14 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:14 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c 1073741824" returned: 0 in 0.473s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:14 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c Jul 28 16:42:14 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:15 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c" returned: 0 in 0.278s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Attempting download of 2d01b148-95b5-41dc-9dfb-00cb3e078af4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'metadata': {}}])) to volume a9d10ed3-9e8b-483b-a219-59c360ff875c. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c191c5e-9d93-4dff-ad8e-a5e8a506a211]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d01b148-95b5-41dc-9dfb-00cb3e078af4_pzib_wdn {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:15 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d01b148-95b5-41dc-9dfb-00cb3e078af4_pzib_wdn Jul 28 16:42:15 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:15 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d01b148-95b5-41dc-9dfb-00cb3e078af4_pzib_wdn" returned: 0 in 0.378s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d01b148-95b5-41dc-9dfb-00cb3e078af4_pzib_wdn {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:15 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d01b148-95b5-41dc-9dfb-00cb3e078af4_pzib_wdn Jul 28 16:42:15 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:15 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d01b148-95b5-41dc-9dfb-00cb3e078af4_pzib_wdn" returned: 1 in 0.356s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d01b148-95b5-41dc-9dfb-00cb3e078af4_pzib_wdn' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bc44cd-217a-46d7-ad69-96a00289c957]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:16 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD Jul 28 16:42:16 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:16 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:16 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD Jul 28 16:42:16 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:16 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:16 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] 2d01b148-95b5-41dc-9dfb-00cb3e078af4 was raw, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:42:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:16 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c Jul 28 16:42:16 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:17 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c" returned: 0 in 0.565s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d01b148-95b5-41dc-9dfb-00cb3e078af4_1fr20qpddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:42:17 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:17 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c 1G Jul 28 16:42:17 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:17 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c 1G" returned: 0 in 0.373s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Downloaded image 2d01b148-95b5-41dc-9dfb-00cb3e078af4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'metadata': {}}])) to volume a9d10ed3-9e8b-483b-a219-59c360ff875c successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Temporary image 2d01b148-95b5-41dc-9dfb-00cb3e078af4 for user a18477741e764b8eb875947671d3e61f is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Marking volume a9d10ed3-9e8b-483b-a219-59c360ff875c as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Copying metadata from image 2d01b148-95b5-41dc-9dfb-00cb3e078af4 to a9d10ed3-9e8b-483b-a219-59c360ff875c. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Creating volume glance metadata for volume a9d10ed3-9e8b-483b-a219-59c360ff875c backed by image 2d01b148-95b5-41dc-9dfb-00cb3e078af4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8083ecc2986e6398824aa2e5d012ebc4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a5bc81-26a7-4882-abee-ec2cbfe55773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d10ed3-9e8b-483b-a219-59c360ff875c', 'volume_size': 1, 'image_id': '2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8083ecc2986e6398824aa2e5d012ebc4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd719791501ea49169d7551fc50797cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '687e0dad5b3adfda340135c7c2a91f3251b1d1b92e17909e06b15a5b7406b372e4c08e4d5b617c26d3742fa003b6bd78aa496c31ce60632ecbc7162a16407204', 'id': '2d01b148-95b5-41dc-9dfb-00cb3e078af4', 'created_at': datetime.datetime(2026, 7, 28, 14, 42, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 42, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d01b148-95b5-41dc-9dfb-00cb3e078af4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbaeb29-6fce-46eb-b7e4-03a6af472717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:17 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Volume volume-a9d10ed3-9e8b-483b-a219-59c360ff875c (a9d10ed3-9e8b-483b-a219-59c360ff875c): created successfully Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbaeb29-6fce-46eb-b7e4-03a6af472717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:17 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Flow 'volume_create_manager' (a13f68f8-9e10-4318-8390-f0d23c5167be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-34451942-d547-479f-8ca6-796ab0075581 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Created volume successfully. Jul 28 16:42:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Acquiring lock "cinder-a9d10ed3-9e8b-483b-a219-59c360ff875c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "cinder-a9d10ed3-9e8b-483b-a219-59c360ff875c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Acquiring lock "cinder-quobyte-a9d10ed3-9e8b-483b-a219-59c360ff875c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "cinder-quobyte-a9d10ed3-9e8b-483b-a219-59c360ff875c" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:18 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8641b6f8-f0c0-4088-a66b-06fd643ccee4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:18 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c Jul 28 16:42:18 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:19 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c" returned: 0 in 0.408s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:19 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c Jul 28 16:42:19 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:19 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a9d10ed3-9e8b-483b-a219-59c360ff875c" returned: 0 in 0.276s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "cinder-quobyte-a9d10ed3-9e8b-483b-a219-59c360ff875c" released by "delete_volume" :: held 0.729s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:19 devstack cinder-volume[88286]: WARNING cinder.quota [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:42:19 devstack cinder-volume[88286]: WARNING cinder.quota [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Created reservations ['706f8b02-18db-4507-beed-523ccdc09f40', 'c0fd772b-f539-4f1f-81da-1adee10419c6', 'aec28f58-d0a9-40c9-9c4f-d6907d2fb3f6', '780cc608-4817-4323-af75-a74b881245cf'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:19 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:42:19 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:20 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.340s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:20 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:42:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Deleted volume successfully. Jul 28 16:42:20 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7f871bb6-7999-4a5e-a8a3-12d1019d7899 tempest-VolumeAndVolumeTypeFromImageTest-1999643348 None] Lock "cinder-a9d10ed3-9e8b-483b-a219-59c360ff875c-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:42:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=10,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (a38243e5-1163-468e-90d9-18c189ed7d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc9c3a7-3e56-4678-b0a8-7dfd75e9dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc9c3a7-3e56-4678-b0a8-7dfd75e9dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566109085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead30601-5775-48cc-bff9-021e6515a5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:41Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c7128f-2dec-4369-aae8-ac11588a8680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c7128f-2dec-4369-aae8-ac11588a8680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbda592b-6dfb-4362-bc16-3cb7951fb3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbda592b-6dfb-4362-bc16-3cb7951fb3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead30601-5775-48cc-bff9-021e6515a5a7', 'volume_name': 'volume-ead30601-5775-48cc-bff9-021e6515a5a7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8154813b-00bc-475c-9982-44c45318ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8154813b-00bc-475c-9982-44c45318ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9d197d-78d7-4254-b1f8-6a203bb9e6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:40 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume ead30601-5775-48cc-bff9-021e6515a5a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead30601-5775-48cc-bff9-021e6515a5a7', 'volume_size': 1} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566109085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead30601-5775-48cc-bff9-021e6515a5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:41Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Creating volume ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:40 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:40 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 1073741824 Jul 28 16:42:40 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (f5b71a47-8f94-42ef-98d9-dd8931cd5b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed5e3ed-2186-4b7f-a487-ce914a816768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed5e3ed-2186-4b7f-a487-ce914a816768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2078747976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc667ddd-e0be-4365-be1c-aef89fd54211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:41Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4e1216-c2e4-4704-af0a-5d187c4916bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4e1216-c2e4-4704-af0a-5d187c4916bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461dec89-ef73-43a3-ba91-94f32050de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461dec89-ef73-43a3-ba91-94f32050de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc667ddd-e0be-4365-be1c-aef89fd54211', 'volume_name': 'volume-dc667ddd-e0be-4365-be1c-aef89fd54211', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01064c0d-1246-4200-afc4-acb59f556653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01064c0d-1246-4200-afc4-acb59f556653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0f65c7-1139-462e-968c-6de841d8d5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume dc667ddd-e0be-4365-be1c-aef89fd54211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc667ddd-e0be-4365-be1c-aef89fd54211', 'volume_size': 1} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:41 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:42:41 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (924dcde2-faa5-4b56-99fe-a35231f491df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ea96c4-9c03-4a65-ac7b-46aa7adb1231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ea96c4-9c03-4a65-ac7b-46aa7adb1231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091893546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e65f1-9d49-4096-b219-c15edfdfd3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:41Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:41 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e63737-f442-428e-a870-06e32c88807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e63737-f442-428e-a870-06e32c88807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84acccae-aa64-4baa-b51d-a3f2e144f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84acccae-aa64-4baa-b51d-a3f2e144f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3e65f1-9d49-4096-b219-c15edfdfd3a3', 'volume_name': 'volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4228f20-2c29-4ae3-996a-d9657589a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4228f20-2c29-4ae3-996a-d9657589a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ac7805-374c-46e9-b786-94f636e077f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:41 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Volume eb3e65f1-9d49-4096-b219-c15edfdfd3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3', 'volume_size': 1} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.534s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 1073741824" returned: 0 in 0.853s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:42:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:41 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 Jul 28 16:42:41 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:42 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7" returned: 0 in 0.448s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2078747976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc667ddd-e0be-4365-be1c-aef89fd54211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:41Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Creating volume dc667ddd-e0be-4365-be1c-aef89fd54211 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:42 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9d197d-78d7-4254-b1f8-6a203bb9e6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead30601-5775-48cc-bff9-021e6515a5a7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da15626-bcdb-48c1-8cfa-f6dc2e65b5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 1073741824 Jul 28 16:42:42 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (9124bd80-7995-45b6-9b21-7d612cd03c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d698376-e1db-4a96-bbaa-050abeb38102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume volume-ead30601-5775-48cc-bff9-021e6515a5a7 (ead30601-5775-48cc-bff9-021e6515a5a7): created successfully Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da15626-bcdb-48c1-8cfa-f6dc2e65b5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (a38243e5-1163-468e-90d9-18c189ed7d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d698376-e1db-4a96-bbaa-050abeb38102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18670906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7b28fd-ae93-4caf-9494-505a143e404a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:42Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b077195e-955b-4537-85a2-fc2e978530af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b077195e-955b-4537-85a2-fc2e978530af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b73a694-3150-41dd-919b-8dc10cfcc08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b73a694-3150-41dd-919b-8dc10cfcc08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f7b28fd-ae93-4caf-9494-505a143e404a', 'volume_name': 'volume-6f7b28fd-ae93-4caf-9494-505a143e404a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0eb2a0b-2777-485d-bc95-cebc518948a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0eb2a0b-2777-485d-bc95-cebc518948a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea654f4-23b5-47b2-b0c5-0b3e513d0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Volume 6f7b28fd-ae93-4caf-9494-505a143e404a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f7b28fd-ae93-4caf-9494-505a143e404a', 'volume_size': 1} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d4452216-9677-4e97-9338-b5cafe8cd710 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created volume successfully. Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (3e09fe9c-1a7c-4597-9446-0a26c955674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282a5dc3-612d-4173-9330-206df7073e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282a5dc3-612d-4173-9330-206df7073e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1514372684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4f7675-c768-47a8-b5f7-ae59e849370c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:43Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016840f4-2915-423c-8ccf-9d6bd0fbfe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016840f4-2915-423c-8ccf-9d6bd0fbfe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a9354e-4227-45ec-a371-9c32e5bad1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a9354e-4227-45ec-a371-9c32e5bad1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4f7675-c768-47a8-b5f7-ae59e849370c', 'volume_name': 'volume-8c4f7675-c768-47a8-b5f7-ae59e849370c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578cdcbd-41c4-4069-b3b9-7270499e2dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578cdcbd-41c4-4069-b3b9-7270499e2dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a6e21d-f4d9-4d57-abd8-f9805c03aef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:42 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Volume 8c4f7675-c768-47a8-b5f7-ae59e849370c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4f7675-c768-47a8-b5f7-ae59e849370c', 'volume_size': 1} Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:42 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 1073741824" returned: 0 in 0.767s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:43 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 Jul 28 16:42:43 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (d3d5f551-ea2b-4c5b-917f-41895935fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691000b6-68cd-486b-a9a6-957b9c2a3ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:43 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211" returned: 0 in 0.433s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091893546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e65f1-9d49-4096-b219-c15edfdfd3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:41Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Creating volume eb3e65f1-9d49-4096-b219-c15edfdfd3a3 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:43 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691000b6-68cd-486b-a9a6-957b9c2a3ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542700394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8694fefa-0a4b-4370-95d3-bdc045de6454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:43Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d56db0-9106-47c2-aace-2b71227849b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:43 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 1073741824 Jul 28 16:42:43 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d56db0-9106-47c2-aace-2b71227849b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4461c747-ed96-4c48-85ea-5ede8394766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4461c747-ed96-4c48-85ea-5ede8394766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8694fefa-0a4b-4370-95d3-bdc045de6454', 'volume_name': 'volume-8694fefa-0a4b-4370-95d3-bdc045de6454', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f25561-5a4f-4497-a0ad-cc009eeb1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f25561-5a4f-4497-a0ad-cc009eeb1d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad43b44-1f86-422f-9e13-940e0738aa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:43 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Volume 8694fefa-0a4b-4370-95d3-bdc045de6454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8694fefa-0a4b-4370-95d3-bdc045de6454', 'volume_size': 1} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0f65c7-1139-462e-968c-6de841d8d5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc667ddd-e0be-4365-be1c-aef89fd54211', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0915ba5-b0e0-41cd-b319-50a8502b0c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:43 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume volume-dc667ddd-e0be-4365-be1c-aef89fd54211 (dc667ddd-e0be-4365-be1c-aef89fd54211): created successfully Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0915ba5-b0e0-41cd-b319-50a8502b0c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (f5b71a47-8f94-42ef-98d9-dd8931cd5b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d6fe0d2a-807f-4383-80c8-196f30c4d96b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created volume successfully. Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (c8d21ba6-38e2-4625-8bea-53529e9593c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090da1ff-d042-4a83-b6c4-74d64279db42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090da1ff-d042-4a83-b6c4-74d64279db42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2087333888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac28024-6891-4f2a-97ca-cd76897a336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:44Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156ab01a-f72d-489d-ad28-794cf58eb1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156ab01a-f72d-489d-ad28-794cf58eb1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ba6680-60cf-4433-80af-ea23815edb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ba6680-60cf-4433-80af-ea23815edb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac28024-6891-4f2a-97ca-cd76897a336b', 'volume_name': 'volume-3ac28024-6891-4f2a-97ca-cd76897a336b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcf8650-d26c-4e5e-ab20-bc7609c6f60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcf8650-d26c-4e5e-ab20-bc7609c6f60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31e2234-3a87-45ca-9368-c29464e29dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Volume 3ac28024-6891-4f2a-97ca-cd76897a336b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac28024-6891-4f2a-97ca-cd76897a336b', 'volume_size': 1} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:44 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 1073741824" returned: 0 in 0.659s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:44 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 Jul 28 16:42:44 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:44 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3" returned: 0 in 0.361s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.186s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18670906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7b28fd-ae93-4caf-9494-505a143e404a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:42Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Creating volume 6f7b28fd-ae93-4caf-9494-505a143e404a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:44 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a 1073741824 Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ac7805-374c-46e9-b786-94f636e077f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:44 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93de15e3-43c5-41b3-a27e-e0f4fbda157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Volume volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 (eb3e65f1-9d49-4096-b219-c15edfdfd3a3): created successfully Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93de15e3-43c5-41b3-a27e-e0f4fbda157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (924dcde2-faa5-4b56-99fe-a35231f491df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ed321523-888a-45d5-8621-5f24c30dd86b tempest-CreateVolumesFromImageTest-955041008 None] Created volume successfully. Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (52be9aee-818f-4328-9b97-a24a9baa735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8840e2d-d9cf-435f-a657-3d0428a25462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8840e2d-d9cf-435f-a657-3d0428a25462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126632617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096dffaa-7dc6-494b-863f-afca325d5c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:45Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab347f94-75ec-482e-baa1-e584a0d74377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab347f94-75ec-482e-baa1-e584a0d74377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ab2e4a-005f-4ce6-94f4-f8baf3233a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ab2e4a-005f-4ce6-94f4-f8baf3233a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096dffaa-7dc6-494b-863f-afca325d5c27', 'volume_name': 'volume-096dffaa-7dc6-494b-863f-afca325d5c27', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afd6139-6382-4665-94fa-770fb46a2565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afd6139-6382-4665-94fa-770fb46a2565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397ad3e8-09cb-41c9-9540-fb9a2a85b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume 096dffaa-7dc6-494b-863f-afca325d5c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096dffaa-7dc6-494b-863f-afca325d5c27', 'volume_size': 1} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (a994148d-bf3a-43f0-9c91-e67588ff6fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb1a595-34c0-4cf9-b606-44f113693003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb1a595-34c0-4cf9-b606-44f113693003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559150614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb590a13-2a12-433b-8527-d1fbddc18e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:45Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cd6730-e306-4c0f-937f-06d95a041c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cd6730-e306-4c0f-937f-06d95a041c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea71dbd-60bd-4051-aa6c-185ac406ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea71dbd-60bd-4051-aa6c-185ac406ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb590a13-2a12-433b-8527-d1fbddc18e87', 'volume_name': 'volume-cb590a13-2a12-433b-8527-d1fbddc18e87', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf7b979-b7d0-42a4-a42e-629cb07969ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf7b979-b7d0-42a4-a42e-629cb07969ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60b119d-3280-4170-9d29-c113447ad473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume cb590a13-2a12-433b-8527-d1fbddc18e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb590a13-2a12-433b-8527-d1fbddc18e87', 'volume_size': 1} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:45 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a 1073741824" returned: 0 in 0.838s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:45 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a Jul 28 16:42:45 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (01b1bc66-3ad2-4574-88e3-3974b0d31968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f86b65b-02f6-4584-ab2e-c3a782066c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a" returned: 0 in 0.381s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1514372684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4f7675-c768-47a8-b5f7-ae59e849370c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:43Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Creating volume 8c4f7675-c768-47a8-b5f7-ae59e849370c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:45 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f86b65b-02f6-4584-ab2e-c3a782066c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e694c44e-2187-4da4-b47e-799cf4890ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:46Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e663057-4b04-4f83-bcec-f567a77b3828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e663057-4b04-4f83-bcec-f567a77b3828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59569aa3-5f7f-4e70-9be5-b7d1b367d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c 1073741824 Jul 28 16:42:45 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59569aa3-5f7f-4e70-9be5-b7d1b367d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e694c44e-2187-4da4-b47e-799cf4890ea9', 'volume_name': 'volume-e694c44e-2187-4da4-b47e-799cf4890ea9', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c052f60a-b44a-4880-8121-445175f1000c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c052f60a-b44a-4880-8121-445175f1000c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8672d070-7075-4fdb-9e93-aee3033f2461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume e694c44e-2187-4da4-b47e-799cf4890ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e694c44e-2187-4da4-b47e-799cf4890ea9', 'volume_size': 1} Jul 28 16:42:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea654f4-23b5-47b2-b0c5-0b3e513d0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7b28fd-ae93-4caf-9494-505a143e404a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a784f2-3466-46f6-bede-df3279ba0a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Volume volume-6f7b28fd-ae93-4caf-9494-505a143e404a (6f7b28fd-ae93-4caf-9494-505a143e404a): created successfully Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a784f2-3466-46f6-bede-df3279ba0a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (9124bd80-7995-45b6-9b21-7d612cd03c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-319c4d82-1de5-46a5-be87-9b7706e72475 tempest-CreateVolumesFromImageTest-955041008 None] Created volume successfully. Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Flow 'volume_create_manager' (a82fa3ca-26bb-44d7-b9d2-6d8f5873b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed9ab02-faa0-43ea-86b0-eb0d8712aa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed9ab02-faa0-43ea-86b0-eb0d8712aa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1015e2ec-54d5-4da5-af98-f9fdcb465eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c1d27ec8884682bb638a159348015a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:46Z,use_quota=True,user_id='6ecd22fa29b140c0bd35834e356e8d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444de9e3-a052-480b-86b1-f23526780e36),volume_type_id=444de9e3-a052-480b-86b1-f23526780e36)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695c4b2c-22fd-4e68-b4e8-ed77886c3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695c4b2c-22fd-4e68-b4e8-ed77886c3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80507ff-f79e-431c-a250-cec0a6a1c09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:46 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (bf071dde-760a-4c52-845e-f30003b29e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba716709-683e-4f26-8bc4-3dd399fc02d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c 1073741824" returned: 0 in 0.677s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba716709-683e-4f26-8bc4-3dd399fc02d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197774400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6deb8cae-1108-41f1-87e0-b22e9635004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:47Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05f5ea6-9984-4f9e-9b8b-96c938fb14bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05f5ea6-9984-4f9e-9b8b-96c938fb14bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c23496-8c7e-424d-8c12-4ef4027b5fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c23496-8c7e-424d-8c12-4ef4027b5fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6deb8cae-1108-41f1-87e0-b22e9635004f', 'volume_name': 'volume-6deb8cae-1108-41f1-87e0-b22e9635004f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b6f8fd-bc0a-433a-ae56-2dd5684c06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b6f8fd-bc0a-433a-ae56-2dd5684c06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921bbee9-6a57-4f2b-bc93-3376e47242a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume 6deb8cae-1108-41f1-87e0-b22e9635004f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6deb8cae-1108-41f1-87e0-b22e9635004f', 'volume_size': 1} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:46 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c Jul 28 16:42:46 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80507ff-f79e-431c-a250-cec0a6a1c09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1015e2ec-54d5-4da5-af98-f9fdcb465eb3', 'volume_name': 'volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3', 'volume_size': 1, 'image_id': '56d03092-49ab-4d5f-8f30-bef4b84202cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56d03092-49ab-4d5f-8f30-bef4b84202cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f614368abb60c5bbe693c1042faf49e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30c1d27ec8884682bb638a159348015a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c8d9bd61a219dff1313351df210c2273029e0b7f792aceaceb93d665796e4834b3ce02b10529156fcec0759f7bba9a789b0eaa142b138fd2555003745e0c91ff', 'id': '56d03092-49ab-4d5f-8f30-bef4b84202cb', 'created_at': datetime.datetime(2026, 7, 28, 14, 42, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 42, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56d03092-49ab-4d5f-8f30-bef4b84202cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c531ff4-539a-4ae4-870b-7c7b25a417c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c531ff4-539a-4ae4-870b-7c7b25a417c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f11c36-1e00-4b0c-8aa0-66873aac28d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Volume 1015e2ec-54d5-4da5-af98-f9fdcb465eb3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3', 'volume_size': 1, 'image_id': '56d03092-49ab-4d5f-8f30-bef4b84202cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56d03092-49ab-4d5f-8f30-bef4b84202cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f614368abb60c5bbe693c1042faf49e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30c1d27ec8884682bb638a159348015a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c8d9bd61a219dff1313351df210c2273029e0b7f792aceaceb93d665796e4834b3ce02b10529156fcec0759f7bba9a789b0eaa142b138fd2555003745e0c91ff', 'id': '56d03092-49ab-4d5f-8f30-bef4b84202cb', 'created_at': datetime.datetime(2026, 7, 28, 14, 42, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 42, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56d03092-49ab-4d5f-8f30-bef4b84202cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Trying to clone 1015e2ec-54d5-4da5-af98-f9fdcb465eb3 from image 56d03092-49ab-4d5f-8f30-bef4b84202cb at location (None, [{'url': 'file:///opt/stack/data/glance/images/56d03092-49ab-4d5f-8f30-bef4b84202cb', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:42:46 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:42:46 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Image download 0.00 MB at 0.00 MB/s Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[809cf6c1-1df9-4b36-94f5-3c051cb2c125]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:47 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.536s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a6e21d-f4d9-4d57-abd8-f9805c03aef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4f7675-c768-47a8-b5f7-ae59e849370c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1853d334-f780-4bb3-ad48-a24ff43151ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (fd77825f-ccb8-4013-aae9-1ba72dd8ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0ab1dd-2e08-4d5c-abc1-544269ee9ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Creating offline snapshot 89843d44-67f9-4f60-85b3-065f3418512c of volume ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:42:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Volume volume-8c4f7675-c768-47a8-b5f7-ae59e849370c (8c4f7675-c768-47a8-b5f7-ae59e849370c): created successfully Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1853d334-f780-4bb3-ad48-a24ff43151ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:47 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD Jul 28 16:42:47 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (3e09fe9c-1a7c-4597-9446-0a26c955674c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[00def45b-f927-4aeb-9c8b-bfb23fdfc5e5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0ab1dd-2e08-4d5c-abc1-544269ee9ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700685755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9ea483-0ce7-4825-885f-3a7a34603158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:47Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9f695a-cd9d-4529-8c75-d735ede57cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9f695a-cd9d-4529-8c75-d735ede57cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a78a7a6-7d79-4a38-b781-96ceac3ae4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a78a7a6-7d79-4a38-b781-96ceac3ae4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9ea483-0ce7-4825-885f-3a7a34603158', 'volume_name': 'volume-fa9ea483-0ce7-4825-885f-3a7a34603158', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68f6ffa-ac6b-4e21-84a3-7dc9d6e0c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68f6ffa-ac6b-4e21-84a3-7dc9d6e0c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c763a07-a4d9-4b35-9cdb-8867792d465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume fa9ea483-0ce7-4825-885f-3a7a34603158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9ea483-0ce7-4825-885f-3a7a34603158', 'volume_size': 1} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c952aa04-f6a2-46db-960f-79043076abc9 tempest-CreateVolumesFromImageTest-955041008 None] Created volume successfully. Jul 28 16:42:47 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 Jul 28 16:42:47 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:47 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:47 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7" returned: 0 in 0.425s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:47 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD Jul 28 16:42:47 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:47 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c 1G Jul 28 16:42:47 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:47 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Temporary image 56d03092-49ab-4d5f-8f30-bef4b84202cb is fetched for user 6ecd22fa29b140c0bd35834e356e8d86. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef0679a-dd4e-4ce3-8642-eba249f2b355]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:48 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c 1G" returned: 0 in 0.493s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ead30601-5775-48cc-bff9-021e6515a5a7 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:48 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD Jul 28 16:42:48 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:48 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ead30601-5775-48cc-bff9-021e6515a5a7 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c Jul 28 16:42:48 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:48 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:48 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ead30601-5775-48cc-bff9-021e6515a5a7 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c" returned: 0 in 0.350s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:48 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c is being set with open permissions: ugo+rw Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:48 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c Jul 28 16:42:48 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:48 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD Jul 28 16:42:48 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:48 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:48 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:48 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.info Jul 28 16:42:48 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:49 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.info" returned: 0 in 0.303s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:49 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.info is being set with open permissions: ugo+rw Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:49 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.info Jul 28 16:42:49 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:49 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.info" returned: 0 in 0.305s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.809s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542700394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8694fefa-0a4b-4370-95d3-bdc045de6454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:43Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Creating volume 8694fefa-0a4b-4370-95d3-bdc045de6454 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:49 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:49 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 1073741824 Jul 28 16:42:49 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d5f7af77-7949-4a0d-9c5a-2b1ed911238e tempest-CreateVolumesFromSnapshotTest-1362070438 None] Create snapshot completed successfully Jul 28 16:42:49 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 1073741824" returned: 0 in 0.522s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:50 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 Jul 28 16:42:50 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:50 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454" returned: 0 in 0.349s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.265s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2087333888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac28024-6891-4f2a-97ca-cd76897a336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2382f524565478e8dbb4a7857f0184d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:44Z,use_quota=True,user_id='642853eadf564a26824b2020cdf86a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Creating volume 3ac28024-6891-4f2a-97ca-cd76897a336b {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:50 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:50 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b 1073741824 Jul 28 16:42:50 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad43b44-1f86-422f-9e13-940e0738aa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8694fefa-0a4b-4370-95d3-bdc045de6454', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24770903-60b6-42f9-8403-e043f7a95246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Volume volume-8694fefa-0a4b-4370-95d3-bdc045de6454 (8694fefa-0a4b-4370-95d3-bdc045de6454): created successfully Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24770903-60b6-42f9-8403-e043f7a95246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (d3d5f551-ea2b-4c5b-917f-41895935fbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (6a294b9f-7880-43a1-adf3-737d30786f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398fe51b-8198-4bfe-9aaf-72e70406b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-83dd52cb-a0ec-4b09-9c7e-2d55e98a5415 tempest-CreateVolumesFromImageTest-955041008 None] Created volume successfully. Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398fe51b-8198-4bfe-9aaf-72e70406b531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012111314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2ccf31-3f45-4838-aaad-c725e30f56c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:50Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28765a1e-8684-442a-afac-f4f4e62cf51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28765a1e-8684-442a-afac-f4f4e62cf51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7be00e4-1451-43b7-a652-b189122bc5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7be00e4-1451-43b7-a652-b189122bc5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2ccf31-3f45-4838-aaad-c725e30f56c3', 'volume_name': 'volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e715e2-f6b7-4ba2-865a-c5316c3f124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e715e2-f6b7-4ba2-865a-c5316c3f124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c8a6bd-c020-4f5e-a469-2a45c447eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume bc2ccf31-3f45-4838-aaad-c725e30f56c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3', 'volume_size': 1} Jul 28 16:42:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (0564ad62-a454-421d-9228-c940f71ac345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8f449d-eab2-48e5-8c65-e3a8eb072aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8f449d-eab2-48e5-8c65-e3a8eb072aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822843548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a6f178-4c72-49bf-a2c1-e82d7269224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:51Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ebe270-571d-485c-89b8-451f365ac499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ebe270-571d-485c-89b8-451f365ac499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e854e1-50c7-421c-9707-51cc2a8771c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e854e1-50c7-421c-9707-51cc2a8771c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a6f178-4c72-49bf-a2c1-e82d7269224c', 'volume_name': 'volume-78a6f178-4c72-49bf-a2c1-e82d7269224c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80723c-c90a-4cdf-a1d8-91f2d284a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80723c-c90a-4cdf-a1d8-91f2d284a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59769c7c-ac1f-4be6-b1d4-743cec897dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume 78a6f178-4c72-49bf-a2c1-e82d7269224c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a6f178-4c72-49bf-a2c1-e82d7269224c', 'volume_size': 1} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:51 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b 1073741824" returned: 0 in 0.788s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:51 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b Jul 28 16:42:51 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:51 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b" returned: 0 in 0.384s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.569s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126632617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096dffaa-7dc6-494b-863f-afca325d5c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:45Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Creating volume 096dffaa-7dc6-494b-863f-afca325d5c27 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:51 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:51 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 1073741824 Jul 28 16:42:51 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (3a75ff6c-8477-4d06-9fc5-5f4783deeb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f58f434-5371-44ea-909d-4406e281e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31e2234-3a87-45ca-9368-c29464e29dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac28024-6891-4f2a-97ca-cd76897a336b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a51e51c-7ec5-4d72-a825-f82633c41027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f58f434-5371-44ea-909d-4406e281e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132488009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525cf178-bb84-4b08-936d-03fd18c7d7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:52Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcf0e6a-04b6-4ed6-a4b4-48f07f923ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcf0e6a-04b6-4ed6-a4b4-48f07f923ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05316788-0530-4468-b03b-5be724feed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05316788-0530-4468-b03b-5be724feed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525cf178-bb84-4b08-936d-03fd18c7d7c6', 'volume_name': 'volume-525cf178-bb84-4b08-936d-03fd18c7d7c6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c1c67f-f87c-4d07-8475-36df38c81dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c1c67f-f87c-4d07-8475-36df38c81dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cbe2f9-5a7e-40c6-8e97-c74776883e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:51 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume 525cf178-bb84-4b08-936d-03fd18c7d7c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525cf178-bb84-4b08-936d-03fd18c7d7c6', 'volume_size': 1} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:51 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Volume volume-3ac28024-6891-4f2a-97ca-cd76897a336b (3ac28024-6891-4f2a-97ca-cd76897a336b): created successfully Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a51e51c-7ec5-4d72-a825-f82633c41027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Flow 'volume_create_manager' (c8d21ba6-38e2-4625-8bea-53529e9593c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5b46d841-2ba7-41fc-92c2-5d84e15d163c tempest-CreateVolumesFromImageTest-955041008 None] Created volume successfully. Jul 28 16:42:51 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-3ac28024-6891-4f2a-97ca-cd76897a336b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-3ac28024-6891-4f2a-97ca-cd76897a336b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-quobyte-3ac28024-6891-4f2a-97ca-cd76897a336b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-3ac28024-6891-4f2a-97ca-cd76897a336b" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (bc879c4f-75b5-4a7e-a20d-a954f249d43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eab671-528c-45e0-a68a-d84948b4612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc3e14-967a-4b43-a612-cedb1690bbe3]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eab671-528c-45e0-a68a-d84948b4612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1137629602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5daffc3-0865-4143-957c-aa4413bbe002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:52Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b0b44c-e0be-4472-b33e-3bca338eb3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b0b44c-e0be-4472-b33e-3bca338eb3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427bc724-3995-4f94-95a2-abd2ca4dc263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427bc724-3995-4f94-95a2-abd2ca4dc263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5daffc3-0865-4143-957c-aa4413bbe002', 'volume_name': 'volume-f5daffc3-0865-4143-957c-aa4413bbe002', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759f2e96-6430-478b-bffc-c442573d2eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759f2e96-6430-478b-bffc-c442573d2eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f134ed2-f91a-46c7-9502-8fcab1fc08ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume f5daffc3-0865-4143-957c-aa4413bbe002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5daffc3-0865-4143-957c-aa4413bbe002', 'volume_size': 1} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:52 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b Jul 28 16:42:52 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:52 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 1073741824" returned: 0 in 0.769s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:52 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 Jul 28 16:42:52 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (12357390-c481-4adc-b30d-f27a45844265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a0e97a-9f3c-4251-b1ce-01fb98302c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a0e97a-9f3c-4251-b1ce-01fb98302c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802380916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c011e24f-0b57-4f0e-84ff-0c6a47d5551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:53Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4c7732-56c7-4f92-831e-6ff4e217a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4c7732-56c7-4f92-831e-6ff4e217a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc6ce04-1f3a-4d47-a2ee-489f3d7c2a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc6ce04-1f3a-4d47-a2ee-489f3d7c2a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c011e24f-0b57-4f0e-84ff-0c6a47d5551b', 'volume_name': 'volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820298fb-3bab-4d91-b413-0ab46570f476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820298fb-3bab-4d91-b413-0ab46570f476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cbeea8-eed1-4046-bd52-58a138dfa200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume c011e24f-0b57-4f0e-84ff-0c6a47d5551b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b', 'volume_size': 1} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b" returned: 0 in 0.522s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:52 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b Jul 28 16:42:52 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:52 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27" returned: 0 in 0.328s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.391s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559150614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb590a13-2a12-433b-8527-d1fbddc18e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:45Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Creating volume cb590a13-2a12-433b-8527-d1fbddc18e87 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:52 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397ad3e8-09cb-41c9-9540-fb9a2a85b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096dffaa-7dc6-494b-863f-afca325d5c27', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 1073741824 Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed1889-a45c-4cd1-be01-c243ab4c9df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:52 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:52 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume volume-096dffaa-7dc6-494b-863f-afca325d5c27 (096dffaa-7dc6-494b-863f-afca325d5c27): created successfully Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed1889-a45c-4cd1-be01-c243ab4c9df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:52 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (52be9aee-818f-4328-9b97-a24a9baa735c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-873c07e6-c23b-4f0f-8ba8-5610c25ae40c tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created volume successfully. Jul 28 16:42:53 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3ac28024-6891-4f2a-97ca-cd76897a336b" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-3ac28024-6891-4f2a-97ca-cd76897a336b" released by "delete_volume" :: held 0.911s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Created reservations ['ee74c939-ab32-4012-9e39-79504ebc49a6', '8bd06021-7b98-4d94-a8fa-8437d25ac3f4', 'fc2fcf30-faba-4fe3-9d68-616866bfa90e', '0c48348b-4147-4d81-a09b-10ecf0ce7802'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:53 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:42:53 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:53 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 1073741824" returned: 0 in 0.521s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:53 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 Jul 28 16:42:53 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:53 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:42:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Deleted volume successfully. Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b5b7125-962c-4487-8b0b-61656de396e0 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-3ac28024-6891-4f2a-97ca-cd76897a336b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:53 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.747s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e694c44e-2187-4da4-b47e-799cf4890ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:46Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Creating volume e694c44e-2187-4da4-b47e-799cf4890ea9 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:53 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:53 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 1073741824 Jul 28 16:42:53 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60b119d-3280-4170-9d29-c113447ad473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb590a13-2a12-433b-8527-d1fbddc18e87', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7491610-f072-4bcb-bcd0-9c8478561bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume volume-cb590a13-2a12-433b-8527-d1fbddc18e87 (cb590a13-2a12-433b-8527-d1fbddc18e87): created successfully Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7491610-f072-4bcb-bcd0-9c8478561bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (a994148d-bf3a-43f0-9c91-e67588ff6fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f1274b49-5a16-450c-8ff4-1493e9582888 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created volume successfully. Jul 28 16:42:54 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 1073741824" returned: 0 in 0.507s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-8694fefa-0a4b-4370-95d3-bdc045de6454-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-8694fefa-0a4b-4370-95d3-bdc045de6454-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:54 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 Jul 28 16:42:54 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-quobyte-8694fefa-0a4b-4370-95d3-bdc045de6454" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-8694fefa-0a4b-4370-95d3-bdc045de6454" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe73e8-fc64-4712-aff2-605c76a61a8d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:54 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 Jul 28 16:42:54 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:54 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9" returned: 0 in 0.337s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.037s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197774400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6deb8cae-1108-41f1-87e0-b22e9635004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:47Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Creating volume 6deb8cae-1108-41f1-87e0-b22e9635004f {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:54 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:54 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f 1073741824 Jul 28 16:42:54 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8672d070-7075-4fdb-9e93-aee3033f2461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e694c44e-2187-4da4-b47e-799cf4890ea9', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41774408-a6bd-4683-986d-63b589c8473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:54 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume volume-e694c44e-2187-4da4-b47e-799cf4890ea9 (e694c44e-2187-4da4-b47e-799cf4890ea9): created successfully Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41774408-a6bd-4683-986d-63b589c8473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (01b1bc66-3ad2-4574-88e3-3974b0d31968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-66e78253-530c-46c4-9b49-517802f658db tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created volume successfully. Jul 28 16:42:54 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454" returned: 0 in 0.513s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:54 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454 Jul 28 16:42:54 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:55 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f 1073741824" returned: 0 in 0.480s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:55 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8694fefa-0a4b-4370-95d3-bdc045de6454" returned: 0 in 0.310s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:55 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f Jul 28 16:42:55 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-8694fefa-0a4b-4370-95d3-bdc045de6454" released by "delete_volume" :: held 0.870s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Created reservations ['8497190d-2183-4614-8e9c-4c36ef7f2033', 'b0c881d8-01d1-40d1-8e3d-9b96bd31c0d9', '89389279-96c8-4caf-85e9-dda19f40bdd1', '93ba4f0f-5304-4f76-96f8-374c19f6fce6'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:55 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:42:55 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-8c4f7675-c768-47a8-b5f7-ae59e849370c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-8c4f7675-c768-47a8-b5f7-ae59e849370c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:55 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f" returned: 0 in 0.335s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.359s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700685755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9ea483-0ce7-4825-885f-3a7a34603158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6edd08333b48fa8144c7e02cf0b585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:47Z,use_quota=True,user_id='5fa2d3d66ea64e399cf4e83a9e488d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Creating volume fa9ea483-0ce7-4825-885f-3a7a34603158 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:55 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:55 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 1073741824 Jul 28 16:42:55 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921bbee9-6a57-4f2b-bc93-3376e47242a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6deb8cae-1108-41f1-87e0-b22e9635004f', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831e7e5a-ce6b-4c6b-90ad-0700dedfaa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-quobyte-8c4f7675-c768-47a8-b5f7-ae59e849370c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:55 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume volume-6deb8cae-1108-41f1-87e0-b22e9635004f (6deb8cae-1108-41f1-87e0-b22e9635004f): created successfully Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831e7e5a-ce6b-4c6b-90ad-0700dedfaa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (bf071dde-760a-4c52-845e-f30003b29e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-8c4f7675-c768-47a8-b5f7-ae59e849370c" acquired by "delete_volume" :: waited 0.063s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0c1eb29f-5125-409a-bac0-d8f8788f50f8 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created volume successfully. Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79e384-0d2f-4f13-a1db-05256cd84b81]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:55 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.504s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:55 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:42:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Deleted volume successfully. Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fd2c9e15-9c4d-4fcf-8352-4dc697ad65cf tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-8694fefa-0a4b-4370-95d3-bdc045de6454-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:56 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c Jul 28 16:42:56 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:56 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 1073741824" returned: 0 in 0.694s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:56 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c" returned: 0 in 0.516s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:56 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c Jul 28 16:42:56 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:56 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 Jul 28 16:42:56 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:56 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-8c4f7675-c768-47a8-b5f7-ae59e849370c" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:56 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158" returned: 0 in 0.295s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-8c4f7675-c768-47a8-b5f7-ae59e849370c" released by "delete_volume" :: held 0.940s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.869s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1015e2ec-54d5-4da5-af98-f9fdcb465eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c1d27ec8884682bb638a159348015a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:46Z,use_quota=True,user_id='6ecd22fa29b140c0bd35834e356e8d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444de9e3-a052-480b-86b1-f23526780e36),volume_type_id=444de9e3-a052-480b-86b1-f23526780e36)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Creating volume 1015e2ec-54d5-4da5-af98-f9fdcb465eb3 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:56 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:56 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 1073741824 Jul 28 16:42:56 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c763a07-a4d9-4b35-9cdb-8867792d465d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9ea483-0ce7-4825-885f-3a7a34603158', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999b947e-84a2-42a8-aaff-3920d57291f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:56 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Volume volume-fa9ea483-0ce7-4825-885f-3a7a34603158 (fa9ea483-0ce7-4825-885f-3a7a34603158): created successfully Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999b947e-84a2-42a8-aaff-3920d57291f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Flow 'volume_create_manager' (fd77825f-ccb8-4013-aae9-1ba72dd8ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:56 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9158f29a-c78f-49c4-81d6-7191b7a65229 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created volume successfully. Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Created reservations ['23b60c34-2acb-4998-8ca3-d13f0c570924', 'e9b3472e-0b32-431d-9486-87204aa9be99', '5f49d29f-7bcf-4b8c-9306-e5940c52d26d', '7413c7e1-e4a0-4a29-a9b0-604135d05eb7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:56 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:42:56 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-fa9ea483-0ce7-4825-885f-3a7a34603158-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:57 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.362s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:42:57 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-fa9ea483-0ce7-4825-885f-3a7a34603158-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:57 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Deleted volume successfully. Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 1073741824" returned: 0 in 0.626s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2f7308e0-b29c-4e47-87b6-171252824936 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-8c4f7675-c768-47a8-b5f7-ae59e849370c-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-quobyte-fa9ea483-0ce7-4825-885f-3a7a34603158" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:57 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 Jul 28 16:42:57 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-fa9ea483-0ce7-4825-885f-3a7a34603158" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c44d6e-9fbf-44e9-9d43-743da55af7e4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:57 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 Jul 28 16:42:57 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:57 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3" returned: 0 in 0.397s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.147s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012111314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2ccf31-3f45-4838-aaad-c725e30f56c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:50Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Creating volume bc2ccf31-3f45-4838-aaad-c725e30f56c3 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:57 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-6f7b28fd-ae93-4caf-9494-505a143e404a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:57 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 1073741824 Jul 28 16:42:57 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-6f7b28fd-ae93-4caf-9494-505a143e404a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Attempting download of 56d03092-49ab-4d5f-8f30-bef4b84202cb ((None, [{'url': 'file:///opt/stack/data/glance/images/56d03092-49ab-4d5f-8f30-bef4b84202cb', 'metadata': {}}])) to volume 1015e2ec-54d5-4da5-af98-f9fdcb465eb3. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6b5ed7-7a1a-499b-9396-2ee1675304de]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-quobyte-6f7b28fd-ae93-4caf-9494-505a143e404a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56d03092-49ab-4d5f-8f30-bef4b84202cb_m0s0lyr6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:57 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158" returned: 0 in 0.547s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-6f7b28fd-ae93-4caf-9494-505a143e404a" acquired by "delete_volume" :: waited 0.059s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:58 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158 Jul 28 16:42:58 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c94cf4-b6e7-413b-8237-8187f8728037]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:58 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56d03092-49ab-4d5f-8f30-bef4b84202cb_m0s0lyr6 Jul 28 16:42:58 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:58 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a Jul 28 16:42:58 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:58 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fa9ea483-0ce7-4825-885f-3a7a34603158" returned: 0 in 0.412s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:58 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56d03092-49ab-4d5f-8f30-bef4b84202cb_m0s0lyr6" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56d03092-49ab-4d5f-8f30-bef4b84202cb_m0s0lyr6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-fa9ea483-0ce7-4825-885f-3a7a34603158" released by "delete_volume" :: held 1.037s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:58 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 1073741824" returned: 0 in 0.704s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created reservations ['960a3dab-2a0b-4ea7-b7d8-923289711f80', '337416b8-099b-4978-aee2-10abffe54389', '926ea18a-61c0-4c9e-bba2-17615e204348', '7b8451bf-9a4b-417b-8751-cbadb24815a9'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:58 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56d03092-49ab-4d5f-8f30-bef4b84202cb_m0s0lyr6 Jul 28 16:42:58 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:58 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 Jul 28 16:42:58 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:58 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:42:58 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:58 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a" returned: 0 in 0.660s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:58 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a Jul 28 16:42:58 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:58 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56d03092-49ab-4d5f-8f30-bef4b84202cb_m0s0lyr6" returned: 1 in 0.452s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56d03092-49ab-4d5f-8f30-bef4b84202cb_m0s0lyr6' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eacbcb4-af3e-4599-8d1f-4455d00c1cb0]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:58 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3" returned: 0 in 0.346s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.782s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822843548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a6f178-4c72-49bf-a2c1-e82d7269224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:51Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Creating volume 78a6f178-4c72-49bf-a2c1-e82d7269224c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:42:58 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:42:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:59 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c8a6bd-c020-4f5e-a469-2a45c447eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:59 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c 1073741824 Jul 28 16:42:59 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7efdea-33e7-48b7-8673-2cd268bd471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.363s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:42:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Deleted volume successfully. Jul 28 16:42:59 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 (bc2ccf31-3f45-4838-aaad-c725e30f56c3): created successfully Jul 28 16:42:59 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD Jul 28 16:42:59 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7efdea-33e7-48b7-8673-2cd268bd471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (6a294b9f-7880-43a1-adf3-737d30786f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:42:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a4fdd884-7373-49f2-b69e-73e2c7dd4d15 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created volume successfully. Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d02b9e74-b993-415e-8979-a50ad0c62d7b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-fa9ea483-0ce7-4825-885f-3a7a34603158-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:59 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6f7b28fd-ae93-4caf-9494-505a143e404a" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-6f7b28fd-ae93-4caf-9494-505a143e404a" released by "delete_volume" :: held 1.168s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Created reservations ['593915d4-0506-4ac3-a800-54f33d4cf011', 'c6335630-5dc1-4075-898f-552649d4be8f', 'baf043a3-f039-4e61-af5f-c5fd266bc7ad', 'c7e101cb-04fe-40af-8c60-95c682ad3f00'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:59 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:59 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:42:59 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:59 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD Jul 28 16:42:59 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-6deb8cae-1108-41f1-87e0-b22e9635004f-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-6deb8cae-1108-41f1-87e0-b22e9635004f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:59 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-quobyte-6deb8cae-1108-41f1-87e0-b22e9635004f" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c 1073741824" returned: 0 in 0.766s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:59 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-6deb8cae-1108-41f1-87e0-b22e9635004f" acquired by "delete_volume" :: waited 0.042s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:42:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Deleted volume successfully. Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d4681-2230-40fd-a38e-fb849f91cf59]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-52e09732-30b1-4b5f-a2a4-38bdadf4149e tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-6f7b28fd-ae93-4caf-9494-505a143e404a-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:42:59 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c Jul 28 16:42:59 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:59 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD" returned: 1 in 0.482s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] 56d03092-49ab-4d5f-8f30-bef4b84202cb was raw, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:42:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:42:59 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 Jul 28 16:42:59 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:42:59 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f Jul 28 16:42:59 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:00 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c" returned: 0 in 0.340s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.350s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132488009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525cf178-bb84-4b08-936d-03fd18c7d7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:52Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Creating volume 525cf178-bb84-4b08-936d-03fd18c7d7c6 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:00 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-eb3e65f1-9d49-4096-b219-c15edfdfd3a3-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:00 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 1073741824 Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59769c7c-ac1f-4be6-b1d4-743cec897dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a6f178-4c72-49bf-a2c1-e82d7269224c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:00 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16549453-3b26-424d-8818-70b4a320e757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-eb3e65f1-9d49-4096-b219-c15edfdfd3a3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:00 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume volume-78a6f178-4c72-49bf-a2c1-e82d7269224c (78a6f178-4c72-49bf-a2c1-e82d7269224c): created successfully Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16549453-3b26-424d-8818-70b4a320e757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (0564ad62-a454-421d-9228-c940f71ac345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:00 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cc36af74-29a9-49c8-8fa1-7e87c660a7ab tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created volume successfully. Jul 28 16:43:00 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "cinder-quobyte-eb3e65f1-9d49-4096-b219-c15edfdfd3a3" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f" returned: 0 in 0.647s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-eb3e65f1-9d49-4096-b219-c15edfdfd3a3" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:00 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f Jul 28 16:43:00 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617a993-cd28-4bce-8b8f-4dbeed7ee57a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:00 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3" returned: 0 in 0.745s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_56d03092-49ab-4d5f-8f30-bef4b84202cb_tben75oddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:43:00 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:00 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 Jul 28 16:43:00 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:00 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 1G Jul 28 16:43:00 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:00 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6deb8cae-1108-41f1-87e0-b22e9635004f" returned: 0 in 0.374s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-6deb8cae-1108-41f1-87e0-b22e9635004f" released by "delete_volume" :: held 1.091s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:00 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 1073741824" returned: 0 in 0.680s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created reservations ['2d9b1e49-ee54-4c28-90a4-6aa07fce948d', 'b8ae2858-39cd-4505-92b6-9ca7d7247a83', 'b3757a50-73d4-4f58-a32f-27af24192adc', '049d7f60-c44a-47c8-b878-d2487a37e8af'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:00 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 Jul 28 16:43:00 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:01 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:01 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:01 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 1G" returned: 0 in 0.436s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Downloaded image 56d03092-49ab-4d5f-8f30-bef4b84202cb ((None, [{'url': 'file:///opt/stack/data/glance/images/56d03092-49ab-4d5f-8f30-bef4b84202cb', 'metadata': {}}])) to volume 1015e2ec-54d5-4da5-af98-f9fdcb465eb3 successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Temporary image 56d03092-49ab-4d5f-8f30-bef4b84202cb for user 6ecd22fa29b140c0bd35834e356e8d86 is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Marking volume 1015e2ec-54d5-4da5-af98-f9fdcb465eb3 as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:43:01 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3" returned: 0 in 0.596s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Copying metadata from image 56d03092-49ab-4d5f-8f30-bef4b84202cb to 1015e2ec-54d5-4da5-af98-f9fdcb465eb3. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Creating volume glance metadata for volume 1015e2ec-54d5-4da5-af98-f9fdcb465eb3 backed by image 56d03092-49ab-4d5f-8f30-bef4b84202cb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '56d03092-49ab-4d5f-8f30-bef4b84202cb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f614368abb60c5bbe693c1042faf49e1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:43:01 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3 Jul 28 16:43:01 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f11c36-1e00-4b0c-8aa0-66873aac28d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3', 'volume_size': 1, 'image_id': '56d03092-49ab-4d5f-8f30-bef4b84202cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56d03092-49ab-4d5f-8f30-bef4b84202cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f614368abb60c5bbe693c1042faf49e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30c1d27ec8884682bb638a159348015a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c8d9bd61a219dff1313351df210c2273029e0b7f792aceaceb93d665796e4834b3ce02b10529156fcec0759f7bba9a789b0eaa142b138fd2555003745e0c91ff', 'id': '56d03092-49ab-4d5f-8f30-bef4b84202cb', 'created_at': datetime.datetime(2026, 7, 28, 14, 42, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 42, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56d03092-49ab-4d5f-8f30-bef4b84202cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f0d571-5014-4b54-8e40-a924d637f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Volume volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 (1015e2ec-54d5-4da5-af98-f9fdcb465eb3): created successfully Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f0d571-5014-4b54-8e40-a924d637f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Flow 'volume_create_manager' (a82fa3ca-26bb-44d7-b9d2-6d8f5873b451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-40f56aea-a341-46c4-b4e5-471685881eed tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Created volume successfully. Jul 28 16:43:01 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6" returned: 0 in 0.386s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.022s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1137629602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5daffc3-0865-4143-957c-aa4413bbe002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:52Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Creating volume f5daffc3-0865-4143-957c-aa4413bbe002 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:01 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cbe2f9-5a7e-40c6-8e97-c74776883e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525cf178-bb84-4b08-936d-03fd18c7d7c6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:01 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 1073741824 Jul 28 16:43:01 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288e0676-aaf7-4e4e-b93d-cd165c206dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 (525cf178-bb84-4b08-936d-03fd18c7d7c6): created successfully Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288e0676-aaf7-4e4e-b93d-cd165c206dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (3a75ff6c-8477-4d06-9fc5-5f4783deeb18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:01 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.473s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Deleted volume successfully. Jul 28 16:43:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3ff03fdc-05a2-4aa0-800b-c612814cbabc tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created volume successfully. Jul 28 16:43:01 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-eb3e65f1-9d49-4096-b219-c15edfdfd3a3" returned: 0 in 0.445s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-quobyte-eb3e65f1-9d49-4096-b219-c15edfdfd3a3" released by "delete_volume" :: held 1.103s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-16b95791-8d26-4a9b-879d-00be7f89cf0b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-6deb8cae-1108-41f1-87e0-b22e9635004f-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Acquiring lock "cinder-1015e2ec-54d5-4da5-af98-f9fdcb465eb3-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Created reservations ['604694c7-c60d-412d-83db-b76d696a6fd7', 'e798d1f0-3c81-4a73-9ed6-1928f9f7e094', 'ed760a2d-63c7-4fde-87c3-9ca4228231b3', '92f19cc4-f003-426d-8626-02e5f008ec46'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "cinder-1015e2ec-54d5-4da5-af98-f9fdcb465eb3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Acquiring lock "cinder-quobyte-1015e2ec-54d5-4da5-af98-f9fdcb465eb3" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "cinder-quobyte-1015e2ec-54d5-4da5-af98-f9fdcb465eb3" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f6b9ac-d460-48f6-a700-f1953b3561ad]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-e694c44e-2187-4da4-b47e-799cf4890ea9-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:02 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:02 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-e694c44e-2187-4da4-b47e-799cf4890ea9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:02 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 Jul 28 16:43:02 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-quobyte-e694c44e-2187-4da4-b47e-799cf4890ea9" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-e694c44e-2187-4da4-b47e-799cf4890ea9" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dcd923-7e1d-4ef9-adb6-a926b8dd5ff0]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:02 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 1073741824" returned: 0 in 0.830s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:02 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 Jul 28 16:43:02 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:02 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 Jul 28 16:43:02 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:02 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.383s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Deleted volume successfully. Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-0471ec27-527f-4337-bed8-fb687ef9a548 tempest-CreateVolumesFromImageTest-955041008 None] Lock "cinder-eb3e65f1-9d49-4096-b219-c15edfdfd3a3-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:02 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3" returned: 0 in 0.588s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:02 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3 Jul 28 16:43:02 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:02 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002" returned: 0 in 0.356s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.901s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802380916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c011e24f-0b57-4f0e-84ff-0c6a47d5551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eef6bbca7d84bec82df8b8315b54875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:42:53Z,use_quota=True,user_id='2f72660379954b89abc9412dbb70ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Creating volume c011e24f-0b57-4f0e-84ff-0c6a47d5551b {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:02 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:02 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b 1073741824 Jul 28 16:43:02 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f134ed2-f91a-46c7-9502-8fcab1fc08ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5daffc3-0865-4143-957c-aa4413bbe002', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c78351-e8c1-45e5-9837-c5a28839c233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:02 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume volume-f5daffc3-0865-4143-957c-aa4413bbe002 (f5daffc3-0865-4143-957c-aa4413bbe002): created successfully Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c78351-e8c1-45e5-9837-c5a28839c233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (bc879c4f-75b5-4a7e-a20d-a954f249d43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2ea6b63d-93d2-45eb-b73d-a342b02fefc7 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created volume successfully. Jul 28 16:43:02 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9" returned: 0 in 0.617s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:02 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9 Jul 28 16:43:02 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:02 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-1015e2ec-54d5-4da5-af98-f9fdcb465eb3" returned: 0 in 0.514s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "cinder-quobyte-1015e2ec-54d5-4da5-af98-f9fdcb465eb3" released by "delete_volume" :: held 1.178s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Created reservations ['7a328dae-77a0-40e4-bc0a-c457789ce381', '3f8532cb-f0ce-48a8-b782-778c9c53770c', '03d9bb6d-6a93-4e9b-96a2-b5375a927071', '8ae5f602-1266-4ce4-aa44-9597b8270120'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:03 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-e694c44e-2187-4da4-b47e-799cf4890ea9" returned: 0 in 0.384s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-e694c44e-2187-4da4-b47e-799cf4890ea9" released by "delete_volume" :: held 1.078s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:03 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:03 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created reservations ['a8f6ec93-5839-40df-9fee-996dd27d3eb5', 'c033dec9-6a73-49bf-ac8d-5efacdab6788', '8cf1494b-3e50-4867-801b-e219ad453cf6', 'e0a81818-1654-4538-b567-acba1b73d1b3'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:03 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b 1073741824" returned: 0 in 0.797s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:03 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:03 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:03 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b Jul 28 16:43:03 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:03 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.327s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Deleted volume successfully. Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e8be7ee8-bef6-4278-a47a-03700408e41e tempest-VolumeAndVolumeTypeFromImageTest-265512396 None] Lock "cinder-1015e2ec-54d5-4da5-af98-f9fdcb465eb3-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:03 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:03 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.396s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Deleted volume successfully. Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cbeea8-eed1-4046-bd52-58a138dfa200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497552dc-b237-4536-932a-fa1bb3216b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:03 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Volume volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b (c011e24f-0b57-4f0e-84ff-0c6a47d5551b): created successfully Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497552dc-b237-4536-932a-fa1bb3216b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Flow 'volume_create_manager' (12357390-c481-4adc-b30d-f27a45844265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f317fb1b-c1df-4ba8-b403-f4382e7e252f tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-e694c44e-2187-4da4-b47e-799cf4890ea9-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e317ad8f-a6ac-4542-9c81-b2f4555d7719 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created volume successfully. Jul 28 16:43:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-cb590a13-2a12-433b-8527-d1fbddc18e87-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-cb590a13-2a12-433b-8527-d1fbddc18e87-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-quobyte-cb590a13-2a12-433b-8527-d1fbddc18e87" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-cb590a13-2a12-433b-8527-d1fbddc18e87" acquired by "delete_volume" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:04 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b388b4b-4830-457f-9cfb-2b7b2ef3ee4d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:04 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 Jul 28 16:43:04 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:05 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87" returned: 0 in 0.486s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:05 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87 Jul 28 16:43:05 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-c011e24f-0b57-4f0e-84ff-0c6a47d5551b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-c011e24f-0b57-4f0e-84ff-0c6a47d5551b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-c011e24f-0b57-4f0e-84ff-0c6a47d5551b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-c011e24f-0b57-4f0e-84ff-0c6a47d5551b" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e51c588-84a1-4363-9a5e-e650b28937b2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:05 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb590a13-2a12-433b-8527-d1fbddc18e87" returned: 0 in 0.396s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-cb590a13-2a12-433b-8527-d1fbddc18e87" released by "delete_volume" :: held 0.968s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:05 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b Jul 28 16:43:05 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created reservations ['fa786d49-d472-43e5-8b89-2f82da9b20d2', 'f9c31bf8-99ce-4396-9d1d-18121ae351dd', '77f30ac1-6164-4104-9769-77dc8792a1ec', '7ba8c1f3-ced8-4ae6-a0a7-77c600b5d3d4'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:05 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:05 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:05 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b" returned: 0 in 0.719s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:06 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b Jul 28 16:43:06 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:06 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.544s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:06 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Deleted volume successfully. Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-916386df-cb4c-4363-921f-56c7cd38e355 tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-cb590a13-2a12-433b-8527-d1fbddc18e87-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:06 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-c011e24f-0b57-4f0e-84ff-0c6a47d5551b" returned: 0 in 0.436s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-c011e24f-0b57-4f0e-84ff-0c6a47d5551b" released by "delete_volume" :: held 1.222s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created reservations ['7715aeea-3875-4df6-baa8-e019866c98f8', '8fe39989-d2a1-4cc1-aed7-8a0f2c190809', 'f9bb65af-1e57-4f7e-b07b-db101d648404', '89e412c0-4f57-46fe-8aa0-5736244827b0'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:06 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:06 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-096dffaa-7dc6-494b-863f-afca325d5c27-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-096dffaa-7dc6-494b-863f-afca325d5c27-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-quobyte-096dffaa-7dc6-494b-863f-afca325d5c27" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-096dffaa-7dc6-494b-863f-afca325d5c27" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d265475-1721-474f-b153-f2af6278ec88]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:07 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Deleted volume successfully. Jul 28 16:43:07 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 Jul 28 16:43:07 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e270d3d0-0b70-471f-a368-4befe55fdbf5 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-c011e24f-0b57-4f0e-84ff-0c6a47d5551b-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-f5daffc3-0865-4143-957c-aa4413bbe002-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-f5daffc3-0865-4143-957c-aa4413bbe002-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Flow 'volume_create_manager' (d7989fa4-1811-465a-a823-e5aefc22ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9fb50f-fa51-4bf1-bd07-1a41e3ce7915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:07 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27" returned: 0 in 0.576s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9fb50f-fa51-4bf1-bd07-1a41e3ce7915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-648176257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5cd9f8-07a3-44a5-bb22-42aca725b516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75dcee9ab92d42ae969796ebbaaea390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:07Z,use_quota=True,user_id='d7fc7179cbff4c7497792e6931cb9e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:07 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27 Jul 28 16:43:07 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd9a17e-a588-484a-940a-b39898294821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd9a17e-a588-484a-940a-b39898294821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f3882b-8caf-4d4a-8b2d-da5c37474181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f3882b-8caf-4d4a-8b2d-da5c37474181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5cd9f8-07a3-44a5-bb22-42aca725b516', 'volume_name': 'volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548d6c4c-d0d5-4d15-aa02-d94684403976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548d6c4c-d0d5-4d15-aa02-d94684403976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4aa0f9-a8f7-47fa-b153-262e79694615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:07 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Volume 4c5cd9f8-07a3-44a5-bb22-42aca725b516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516', 'volume_size': 1} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-648176257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5cd9f8-07a3-44a5-bb22-42aca725b516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75dcee9ab92d42ae969796ebbaaea390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:07Z,use_quota=True,user_id='d7fc7179cbff4c7497792e6931cb9e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Creating volume 4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:07 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:07 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 1073741824 Jul 28 16:43:07 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-f5daffc3-0865-4143-957c-aa4413bbe002" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-f5daffc3-0865-4143-957c-aa4413bbe002" acquired by "delete_volume" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7eba4-3f1a-4166-9531-8729befd44fb]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:07 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 Jul 28 16:43:07 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:08 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-096dffaa-7dc6-494b-863f-afca325d5c27" returned: 0 in 0.484s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-096dffaa-7dc6-494b-863f-afca325d5c27" released by "delete_volume" :: held 1.136s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created reservations ['1345410e-72c6-4623-8745-c88c300079d9', '2c95c55a-ce17-4328-a673-0a8ffa6fa512', '63841251-d8b0-4596-81b5-f30ddc7a08bb', '19d8c468-ee8d-48a6-9ddb-b5d73b95333e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:08 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:08 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:08 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:08 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 1073741824" returned: 0 in 0.756s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002" returned: 0 in 0.590s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:08 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002 Jul 28 16:43:08 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:08 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 Jul 28 16:43:08 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:08 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.383s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Deleted volume successfully. Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3c27bb9f-1dfb-4ccc-92a8-c4bc6b25d12b tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-096dffaa-7dc6-494b-863f-afca325d5c27-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:08 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f5daffc3-0865-4143-957c-aa4413bbe002" returned: 0 in 0.409s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-f5daffc3-0865-4143-957c-aa4413bbe002" released by "delete_volume" :: held 1.083s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:08 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516" returned: 0 in 0.410s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4aa0f9-a8f7-47fa-b153-262e79694615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04406fe1-cd2e-40f6-a3d8-36759941aa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created reservations ['5d6e4bf5-4068-4682-bb11-1b74af7129d4', '8f6661a4-8d02-41ce-8b64-266209586ee0', '9325e461-3106-437e-9bbe-6ff7e30b2fb2', '2c9c902b-6dfd-4ad4-b403-b6584479c46c'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Volume volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 (4c5cd9f8-07a3-44a5-bb22-42aca725b516): created successfully Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04406fe1-cd2e-40f6-a3d8-36759941aa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Flow 'volume_create_manager' (d7989fa4-1811-465a-a823-e5aefc22ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:08 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-00bf4270-53de-4478-bfb5-954d83fba209 tempest-VolumeDependencyTests-581206819 None] Created volume successfully. Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:09 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:09 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-dc667ddd-e0be-4365-be1c-aef89fd54211-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-dc667ddd-e0be-4365-be1c-aef89fd54211-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "cinder-quobyte-dc667ddd-e0be-4365-be1c-aef89fd54211" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-dc667ddd-e0be-4365-be1c-aef89fd54211" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[66235641-ca71-4177-8c9f-17b34b6eff5c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:09 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.360s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Deleted volume successfully. Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce49b533-136c-4eb6-858c-5e8f0a54a837 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-f5daffc3-0865-4143-957c-aa4413bbe002-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:09 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 Jul 28 16:43:09 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:09 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211" returned: 0 in 0.539s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-525cf178-bb84-4b08-936d-03fd18c7d7c6-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:09 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211 Jul 28 16:43:09 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-525cf178-bb84-4b08-936d-03fd18c7d7c6-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Creating offline snapshot ceaa559d-bde8-48bc-9d36-caf7c7a879bb of volume 4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-525cf178-bb84-4b08-936d-03fd18c7d7c6" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a23a3-a46f-4b50-83ba-9f027b22527c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-525cf178-bb84-4b08-936d-03fd18c7d7c6" acquired by "delete_volume" :: waited 0.046s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a715f605-c094-46fc-bcb0-cad74da89193]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:10 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-dc667ddd-e0be-4365-be1c-aef89fd54211" returned: 0 in 0.413s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:10 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 Jul 28 16:43:10 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-quobyte-dc667ddd-e0be-4365-be1c-aef89fd54211" released by "delete_volume" :: held 1.034s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:10 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 Jul 28 16:43:10 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Created reservations ['b70f2542-9652-4dc4-9f12-57dccf87f097', 'c13fce69-af5a-4062-afa2-41e2143cbb38', '79975a8f-ed36-495a-b0f1-708600f9b41f', '97963882-6571-4c5c-9bf7-0d8aa9770488'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:10 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:10 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:10 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:10 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6" returned: 0 in 0.561s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516" returned: 0 in 0.666s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:10 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6 Jul 28 16:43:10 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:10 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb 1G Jul 28 16:43:10 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:10 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.371s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Deleted volume successfully. Jul 28 16:43:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-23e6615f-205a-42b1-b8da-957c166387bf tempest-CreateVolumesFromSourceVolumeTest-2076102989 None] Lock "cinder-dc667ddd-e0be-4365-be1c-aef89fd54211-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:11 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-525cf178-bb84-4b08-936d-03fd18c7d7c6" returned: 0 in 0.341s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-525cf178-bb84-4b08-936d-03fd18c7d7c6" released by "delete_volume" :: held 0.973s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created reservations ['4012238c-f3ae-4eb8-a41a-52b4d81f12b9', '7af01eae-6a58-4821-a6ce-3b19c566067d', '78a64fa9-1142-4e46-96ea-1c37517e02e6', 'ca898c8c-d2e7-43f1-8b4b-e5c4e9ff529b'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:11 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:11 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:11 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb 1G" returned: 0 in 0.641s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:11 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb Jul 28 16:43:11 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:11 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.341s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Deleted volume successfully. Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d1456fe1-0d00-4bb2-8038-5dec907d47f9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-525cf178-bb84-4b08-936d-03fd18c7d7c6-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:11 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb" returned: 0 in 0.411s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:11 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb is being set with open permissions: ugo+rw Jul 28 16:43:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:11 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb Jul 28 16:43:11 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:12 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb" returned: 0 in 0.357s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-78a6f178-4c72-49bf-a2c1-e82d7269224c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:12 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.info Jul 28 16:43:12 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-78a6f178-4c72-49bf-a2c1-e82d7269224c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-78a6f178-4c72-49bf-a2c1-e82d7269224c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-78a6f178-4c72-49bf-a2c1-e82d7269224c" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1614bc0-0336-4f70-b005-9c90bd35aacc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:12 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:12 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.info" returned: 0 in 0.419s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:12 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.info is being set with open permissions: ugo+rw Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:12 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:12 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.info Jul 28 16:43:12 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:12 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (3a0967cb-4f9d-4adc-afdf-2e8f99266598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4b9d22-7a94-4845-9c2a-ebce882140e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4b9d22-7a94-4845-9c2a-ebce882140e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2063123508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453aa774-184f-4671-9799-cbdb26eb6e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:13Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4185b224-b9d6-4ca6-8cba-5303442ce66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:13 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4185b224-b9d6-4ca6-8cba-5303442ce66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34361803-ec59-4f7f-847c-c0ceaf83a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34361803-ec59-4f7f-847c-c0ceaf83a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453aa774-184f-4671-9799-cbdb26eb6e17', 'volume_name': 'volume-453aa774-184f-4671-9799-cbdb26eb6e17', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77295c4d-bbdc-42ed-a67f-1b3ead850939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77295c4d-bbdc-42ed-a67f-1b3ead850939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902d14dd-e469-40e5-b800-6a4b01668319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:13 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Volume 453aa774-184f-4671-9799-cbdb26eb6e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453aa774-184f-4671-9799-cbdb26eb6e17', 'volume_size': 1} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.info" returned: 0 in 0.426s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:13 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2063123508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453aa774-184f-4671-9799-cbdb26eb6e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:13Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Creating volume 453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:13 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c" returned: 0 in 0.671s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:13 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 1073741824 Jul 28 16:43:13 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:13 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c Jul 28 16:43:13 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:13 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-676ea8d3-4175-4b45-8c1d-f59102eb8cc9 tempest-VolumeDependencyTests-581206819 None] Create snapshot completed successfully Jul 28 16:43:13 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-78a6f178-4c72-49bf-a2c1-e82d7269224c" returned: 0 in 0.334s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-78a6f178-4c72-49bf-a2c1-e82d7269224c" released by "delete_volume" :: held 1.065s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created reservations ['1ae22572-1bf2-454e-9bea-d06c8933f462', 'b32275b9-786d-4dc1-8185-c82a7b815dbd', '937c202f-15c1-473b-868a-fd2b6248f661', 'd77718ce-9619-4c21-9b33-3c7eac3928fc'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:13 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:13 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:13 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 1073741824" returned: 0 in 0.685s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:13 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 Jul 28 16:43:13 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:14 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.376s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Deleted volume successfully. Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-a1bf50d5-438a-4655-9ca4-5a899fea76fb tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-78a6f178-4c72-49bf-a2c1-e82d7269224c-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:14 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17" returned: 0 in 0.357s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902d14dd-e469-40e5-b800-6a4b01668319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453aa774-184f-4671-9799-cbdb26eb6e17', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcfdd26-f651-4e45-ab85-95b9269de959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:14 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Volume volume-453aa774-184f-4671-9799-cbdb26eb6e17 (453aa774-184f-4671-9799-cbdb26eb6e17): created successfully Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcfdd26-f651-4e45-ab85-95b9269de959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (3a0967cb-4f9d-4adc-afdf-2e8f99266598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e0720cb6-d0ed-44c7-ac4d-937956d4ab5b tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-bc2ccf31-3f45-4838-aaad-c725e30f56c3-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-bc2ccf31-3f45-4838-aaad-c725e30f56c3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-bc2ccf31-3f45-4838-aaad-c725e30f56c3" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-bc2ccf31-3f45-4838-aaad-c725e30f56c3" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a877321-92fb-4da7-a81e-aad4ffde6d68]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:14 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 Jul 28 16:43:14 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Flow 'volume_create_manager' (9e0d55f3-f65c-4d59-9c64-77579fadc5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa5cf7a-a8a8-4208-9ca3-5f990e4ad5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa5cf7a-a8a8-4208-9ca3-5f990e4ad5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1228417856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034da424-b32b-49c7-b51b-bc73d9b6e0d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75dcee9ab92d42ae969796ebbaaea390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ceaa559d-bde8-48bc-9d36-caf7c7a879bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:15Z,use_quota=True,user_id='d7fc7179cbff4c7497792e6931cb9e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cd60c5-5c24-43dd-b45b-579e4135bf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cd60c5-5c24-43dd-b45b-579e4135bf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe3634e-964b-4991-80bf-f9a81ce4ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe3634e-964b-4991-80bf-f9a81ce4ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '034da424-b32b-49c7-b51b-bc73d9b6e0d1', 'volume_name': 'volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1', 'volume_size': 1, 'snapshot_id': 'ceaa559d-bde8-48bc-9d36-caf7c7a879bb'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc129b0-59aa-45eb-96bc-b597afc5a393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc129b0-59aa-45eb-96bc-b597afc5a393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e8885f-f21c-4806-a653-839ba15c9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:15 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Volume 034da424-b32b-49c7-b51b-bc73d9b6e0d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1', 'volume_size': 1, 'snapshot_id': 'ceaa559d-bde8-48bc-9d36-caf7c7a879bb'} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-quobyte-ceaa559d-bde8-48bc-9d36-caf7c7a879bb-034da424-b32b-49c7-b51b-bc73d9b6e0d1" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-ceaa559d-bde8-48bc-9d36-caf7c7a879bb-034da424-b32b-49c7-b51b-bc73d9b6e0d1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Creating volume 034da424-b32b-49c7-b51b-bc73d9b6e0d1 from snapshot ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-quobyte-034da424-b32b-49c7-b51b-bc73d9b6e0d1" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-034da424-b32b-49c7-b51b-bc73d9b6e0d1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] snapshot: ceaa559d-bde8-48bc-9d36-caf7c7a879bb, volume: 034da424-b32b-49c7-b51b-bc73d9b6e0d1, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1676cc7e-e2b6-481b-abff-de60fda8843f]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:15 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3" returned: 0 in 0.588s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:15 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3 Jul 28 16:43:15 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:15 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb Jul 28 16:43:15 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:15 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-bc2ccf31-3f45-4838-aaad-c725e30f56c3" returned: 0 in 0.387s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-bc2ccf31-3f45-4838-aaad-c725e30f56c3" released by "delete_volume" :: held 1.051s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created reservations ['7fa7cc95-7495-48eb-a880-e064af1abec3', 'deb269b8-0f8f-45f6-9903-fcfa6b7e3976', '4f620621-a7e7-4af8-b3e8-269e8a77c07c', '49e67790-8a64-40a7-811e-1a133e3113a3'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:15 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb" returned: 0 in 0.575s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e97ee04-c493-4b48-9f39-bfc821e1d6be]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:16 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:16 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:16 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 Jul 28 16:43:16 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:16 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.325s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:16 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Deleted volume successfully. Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7a832c4c-6ee2-4dda-b1e0-f63d0b074f0a tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-bc2ccf31-3f45-4838-aaad-c725e30f56c3-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:16 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-0a934853-90e3-4a6e-aea1-b8a549f2ee9e tempest-ProjectAdminTests-2136279656 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757698059082, 'free_capacity_gb': 1775.757698059082, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88286) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 16:43:16 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 Jul 28 16:43:16 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-89843d44-67f9-4f60-85b3-065f3418512c-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-89843d44-67f9-4f60-85b3-065f3418512c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-ead30601-5775-48cc-bff9-021e6515a5a7" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-ead30601-5775-48cc-bff9-021e6515a5a7" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-89843d44-67f9-4f60-85b3-065f3418512c" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-89843d44-67f9-4f60-85b3-065f3418512c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Deleting offline snapshot 89843d44-67f9-4f60-85b3-065f3418512c of volume ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] snapshot_file for this snap is: volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aebb85-fdce-4917-b4c1-1917ac9b0b6d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:17 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c Jul 28 16:43:17 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:18 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c" returned: 0 in 1.255s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ead30601-5775-48cc-bff9-021e6515a5a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:43:18 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc514f-a08b-4ec1-942a-3168f70d6021]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:18 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 Jul 28 16:43:18 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:19 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7" returned: 0 in 1.169s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:19 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c Jul 28 16:43:19 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:20 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c" returned: 0 in 1.018s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:20 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c Jul 28 16:43:20 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:21 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7.89843d44-67f9-4f60-85b3-065f3418512c" returned: 0 in 1.092s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-89843d44-67f9-4f60-85b3-065f3418512c" released by "_delete_snapshot" :: held 4.820s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:21 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-ead30601-5775-48cc-bff9-021e6515a5a7" released by "delete_snapshot" :: held 4.879s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created reservations ['7a7ba734-7ddb-4daf-ba57-9d80336e93fe', 'ddef48b5-ec47-4388-8f60-31a1fa7ea294', '5d67c68c-74c1-49b5-af10-c1a3d2c129e7', '9ed9e9b1-27e2-43f5-9cfa-804dc5ba8e6e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Delete snapshot completed successfully. Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e675bab6-ae95-482d-ac07-f40d67958eb9 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-89843d44-67f9-4f60-85b3-065f3418512c-delete_snapshot" released by "delete_snapshot" :: held 5.453s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:22 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1" returned: 0 in 6.052s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[1467d849-a115-4d2f-93e9-92cb23e0d22f]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-ead30601-5775-48cc-bff9-021e6515a5a7-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-ead30601-5775-48cc-bff9-021e6515a5a7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "cinder-quobyte-ead30601-5775-48cc-bff9-021e6515a5a7" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-ead30601-5775-48cc-bff9-021e6515a5a7" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:22 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 Jul 28 16:43:22 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a35607d-8959-47f2-b60c-6b389f9a119b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:22 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 Jul 28 16:43:22 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:23 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:23 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7" returned: 0 in 0.452s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516" returned: 0 in 0.646s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:43:23 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Converted 1024.00 MB image at 169.12 MB/s Jul 28 16:43:23 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 is being set with open permissions: ugo+rw Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:23 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7 Jul 28 16:43:23 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:23 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 Jul 28 16:43:23 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:23 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-ead30601-5775-48cc-bff9-021e6515a5a7" returned: 0 in 0.293s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-quobyte-ead30601-5775-48cc-bff9-021e6515a5a7" released by "delete_volume" :: held 0.845s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:23 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1" returned: 0 in 0.326s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-034da424-b32b-49c7-b51b-bc73d9b6e0d1" released by "_copy_volume_from_snapshot" :: held 8.232s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-ceaa559d-bde8-48bc-9d36-caf7c7a879bb-034da424-b32b-49c7-b51b-bc73d9b6e0d1" released by "_create_volume_from_snapshot" :: held 8.272s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.291s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.810s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot 04f5cbc7-16a0-4f42-bfca-7f80ee68d407 of volume 453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Created reservations ['6679a00b-daee-41b8-a217-351f005c787c', 'ee209a38-d11e-483d-9eb7-930b446acd3d', '0b796899-3856-406e-991b-fe5e8c99a764', '515f0246-c2a7-4ea4-9904-5c7e3eb6023e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e8885f-f21c-4806-a653-839ba15c9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1', 'volume_size': 1, 'snapshot_id': 'ceaa559d-bde8-48bc-9d36-caf7c7a879bb'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f6fe93-7e93-4d84-a88b-1d0d69b25454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ee9a9-8646-407c-81b9-ad8c4d3cbebc]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:23 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Volume volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 (034da424-b32b-49c7-b51b-bc73d9b6e0d1): created successfully Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f6fe93-7e93-4d84-a88b-1d0d69b25454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Flow 'volume_create_manager' (9e0d55f3-f65c-4d59-9c64-77579fadc5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c89a33c5-1f7f-4d22-9201-afdf3ff0e29a tempest-VolumeDependencyTests-581206819 None] Created volume successfully. Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:23 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 Jul 28 16:43:23 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:23 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:23 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:24 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-ceaa559d-bde8-48bc-9d36-caf7c7a879bb-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.348s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:24 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Deleted volume successfully. Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Lock "cinder-ceaa559d-bde8-48bc-9d36-caf7c7a879bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-quobyte-4c5cd9f8-07a3-44a5-bb22-42aca725b516" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-4c5cd9f8-07a3-44a5-bb22-42aca725b516" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-quobyte-ceaa559d-bde8-48bc-9d36-caf7c7a879bb" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:24 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-9ef8ccd2-1c7e-4feb-876f-cbce7c3f4f54 tempest-CreateVolumesFromSnapshotTest-1362070438 None] Lock "cinder-ead30601-5775-48cc-bff9-021e6515a5a7-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17" returned: 0 in 0.598s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-ceaa559d-bde8-48bc-9d36-caf7c7a879bb" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Deleting offline snapshot ceaa559d-bde8-48bc-9d36-caf7c7a879bb of volume 4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:43:24 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 1G Jul 28 16:43:24 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] snapshot_file for this snap is: volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a3052-5e88-44c2-8953-60f0c973f95c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:24 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb Jul 28 16:43:24 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:24 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 1G" returned: 0 in 0.525s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453aa774-184f-4671-9799-cbdb26eb6e17 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:24 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb" returned: 0 in 0.473s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:43:24 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453aa774-184f-4671-9799-cbdb26eb6e17 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 Jul 28 16:43:24 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa15e52-fbf3-4bdf-ac5b-ac1f7a376ee6]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:24 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 Jul 28 16:43:24 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:25 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453aa774-184f-4671-9799-cbdb26eb6e17 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407" returned: 0 in 0.455s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:25 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 is being set with open permissions: ugo+rw Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:25 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 Jul 28 16:43:25 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:25 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516" returned: 0 in 0.532s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:25 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb Jul 28 16:43:25 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:25 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407" returned: 0 in 0.319s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:25 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.info Jul 28 16:43:25 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:25 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb" returned: 0 in 0.498s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:25 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb Jul 28 16:43:25 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:26 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.info" returned: 0 in 0.440s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:26 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.info is being set with open permissions: ugo+rw Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:26 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.info Jul 28 16:43:26 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:26 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516.ceaa559d-bde8-48bc-9d36-caf7c7a879bb" returned: 0 in 0.427s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-ceaa559d-bde8-48bc-9d36-caf7c7a879bb" released by "_delete_snapshot" :: held 2.125s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-4c5cd9f8-07a3-44a5-bb22-42aca725b516" released by "delete_snapshot" :: held 2.187s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:26 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.info" returned: 0 in 0.388s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.889s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-a96c96ae-d35b-4a9c-9ee8-1a3aec51078e tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Created reservations ['48782423-5c0e-401d-9a7c-3ab3f8e164d6', '907581c1-14da-4180-b169-b9bae01a78b1', '37ca6c50-2c60-4ffd-aafb-713dd5a89718', '6027a49d-5355-4609-80ee-615876143df5'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Delete snapshot completed successfully. Jul 28 16:43:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a00b54e-1774-43eb-b3cf-84d0265198df tempest-VolumeDependencyTests-581206819 None] Lock "cinder-ceaa559d-bde8-48bc-9d36-caf7c7a879bb-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-4c5cd9f8-07a3-44a5-bb22-42aca725b516-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-4c5cd9f8-07a3-44a5-bb22-42aca725b516-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-04f5cbc7-16a0-4f42-bfca-7f80ee68d407-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-quobyte-4c5cd9f8-07a3-44a5-bb22-42aca725b516" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-4c5cd9f8-07a3-44a5-bb22-42aca725b516" acquired by "delete_volume" :: waited 0.037s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Lock "cinder-04f5cbc7-16a0-4f42-bfca-7f80ee68d407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.098s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-453aa774-184f-4671-9799-cbdb26eb6e17" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-453aa774-184f-4671-9799-cbdb26eb6e17" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-04f5cbc7-16a0-4f42-bfca-7f80ee68d407" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4889b5-8ffa-48e5-b5ef-dfc220ebd8b1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-04f5cbc7-16a0-4f42-bfca-7f80ee68d407" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot 04f5cbc7-16a0-4f42-bfca-7f80ee68d407 of volume 453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b75f0-ca31-4a0d-b988-d330c854226a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:27 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 Jul 28 16:43:27 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:27 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 Jul 28 16:43:27 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:28 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516" returned: 0 in 0.468s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:28 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516 Jul 28 16:43:28 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:28 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407" returned: 0 in 0.469s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-453aa774-184f-4671-9799-cbdb26eb6e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[56302597-a769-4ec0-aa11-576a2df065e9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:28 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 Jul 28 16:43:28 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:28 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4c5cd9f8-07a3-44a5-bb22-42aca725b516" returned: 0 in 0.348s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-4c5cd9f8-07a3-44a5-bb22-42aca725b516" released by "delete_volume" :: held 0.940s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Created reservations ['6f06e28b-7ff2-4d5b-976f-d5efb3bac0c8', '476ba132-681b-4171-9876-a27f52a2681d', 'b9416644-1451-4a9e-bfed-3eb86df6e201', '55ab3e35-338f-4d03-bf34-a595e3960bdd'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:28 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17" returned: 0 in 0.536s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:28 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:28 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:28 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 Jul 28 16:43:28 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:29 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.349s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:29 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Deleted volume successfully. Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6f2612b9-625a-4615-9860-08c5ea8e6a88 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-4c5cd9f8-07a3-44a5-bb22-42aca725b516-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:29 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407" returned: 0 in 0.523s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:29 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407 Jul 28 16:43:29 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:29 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17.04f5cbc7-16a0-4f42-bfca-7f80ee68d407" returned: 0 in 0.337s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-04f5cbc7-16a0-4f42-bfca-7f80ee68d407" released by "_delete_snapshot" :: held 2.088s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-034da424-b32b-49c7-b51b-bc73d9b6e0d1-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-453aa774-184f-4671-9799-cbdb26eb6e17" released by "delete_snapshot" :: held 2.138s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-034da424-b32b-49c7-b51b-bc73d9b6e0d1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "cinder-quobyte-034da424-b32b-49c7-b51b-bc73d9b6e0d1" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-034da424-b32b-49c7-b51b-bc73d9b6e0d1" acquired by "delete_volume" :: waited 0.043s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:29 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Created reservations ['4ffc402c-9217-4e2c-a8ee-c31b1798e397', '51d4ae80-7d57-47ff-98ee-ad19cc93566b', '51c79985-f092-4e8e-97f2-8a8567332ed1', '4c51dab4-3542-4b6e-a717-d3b71121f8bb'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73ef0bb-5eb8-412e-abc0-98e3e4c1c399]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:30 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bcb764f4-7327-438a-90f2-ca57108a178d tempest-ProjectMemberTests-1589750625 None] Lock "cinder-04f5cbc7-16a0-4f42-bfca-7f80ee68d407-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:30 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 Jul 28 16:43:30 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:30 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:30 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1 Jul 28 16:43:30 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:30 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-453aa774-184f-4671-9799-cbdb26eb6e17-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-034da424-b32b-49c7-b51b-bc73d9b6e0d1" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-quobyte-034da424-b32b-49c7-b51b-bc73d9b6e0d1" released by "delete_volume" :: held 0.977s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:30 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-453aa774-184f-4671-9799-cbdb26eb6e17-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-453aa774-184f-4671-9799-cbdb26eb6e17" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-453aa774-184f-4671-9799-cbdb26eb6e17" acquired by "delete_volume" :: waited 0.036s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Created reservations ['7144ec9c-d7c1-435c-bd0b-3ffe193e04dc', '49e1c279-a6f1-4e1b-a372-2e5a7573a1b3', '20d99415-37c3-41e9-89b7-4433c39fd5a1', '272aba4d-50d3-401e-8dd3-74adcc9e6675'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf9513c-cda5-4e1d-8a18-7dd635fabfae]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:31 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 Jul 28 16:43:31 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:31 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:31 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:31 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.346s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:31 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Deleted volume successfully. Jul 28 16:43:31 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17" returned: 0 in 0.513s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:31 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17 Jul 28 16:43:31 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:31 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-f9a25244-cf3c-435e-ae36-2ce05f052749 tempest-VolumeDependencyTests-581206819 None] Lock "cinder-034da424-b32b-49c7-b51b-bc73d9b6e0d1-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:32 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-453aa774-184f-4671-9799-cbdb26eb6e17" returned: 0 in 0.381s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-453aa774-184f-4671-9799-cbdb26eb6e17" released by "delete_volume" :: held 1.016s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Created reservations ['eb268aa3-da71-4ce1-b4dc-055024152fc3', 'd935a91d-d866-4fdb-8218-d99ae69cc9c9', '5e768eeb-6002-4805-978f-b00c98c9f5fa', '97111d11-37db-415b-98b5-dfc714889aa7'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:32 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:32 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:32 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.283s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:43:32 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6466a710-12b8-4b91-ba38-2c89386d3fd3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-453aa774-184f-4671-9799-cbdb26eb6e17-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Flow 'volume_create_manager' (e58064ff-c2fd-492e-82e1-53b89fbd7851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8082e0-0c7a-4b83-844a-3fdf1467a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8082e0-0c7a-4b83-844a-3fdf1467a7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41884534-ac56-46c4-ba1d-78026080e86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac35acb462d40ea864d7a56fa269c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:33Z,use_quota=True,user_id='24fd64e3017f41eca35a951c5e47985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf553b1a-e8fa-4dfe-a162-8f6214dadf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf553b1a-e8fa-4dfe-a162-8f6214dadf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219ed38e-ca4e-4c1b-9d68-c687b87bc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.image.glance [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Creating Keystone auth plugin from conf {{(pid=88286) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (84217cc6-9fff-4d15-ac8e-267ed44d785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc0154-057e-4366-8f22-22676aa944eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:33 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc0154-057e-4366-8f22-22676aa944eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033097524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fefaf98-a210-41c5-9ed3-0a5493575a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:34Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e739bc-1222-48ca-becf-afeaea7c8adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e739bc-1222-48ca-becf-afeaea7c8adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a21f2cb-6a80-4ce4-8a60-3c5c51618bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a21f2cb-6a80-4ce4-8a60-3c5c51618bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fefaf98-a210-41c5-9ed3-0a5493575a3d', 'volume_name': 'volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b93adc1-0dc6-4a4c-a32b-668b222fe1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b93adc1-0dc6-4a4c-a32b-668b222fe1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57bafcd-31b2-4186-9082-f722e817a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:34 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Volume 0fefaf98-a210-41c5-9ed3-0a5493575a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d', 'volume_size': 1} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033097524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fefaf98-a210-41c5-9ed3-0a5493575a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:34Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Creating volume 0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:34 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:34 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d 1073741824 Jul 28 16:43:34 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219ed38e-ca4e-4c1b-9d68-c687b87bc90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41884534-ac56-46c4-ba1d-78026080e86c', 'volume_name': 'volume-41884534-ac56-46c4-ba1d-78026080e86c', 'volume_size': 1, 'image_id': 'a46215a8-7d31-4833-bed6-3a4dd84f072f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a46215a8-7d31-4833-bed6-3a4dd84f072f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53a7d9cb031dc1ea92f80e18ba62498f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ac35acb462d40ea864d7a56fa269c1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03920281562e49757acbeff63a878765f5f31516b39d09f0b48e38fff8b4e39c2056dad0a9b3b85e0a4162e854a7ad2a62bd391dddbe004f0ce06a77e21c4bc4', 'id': 'a46215a8-7d31-4833-bed6-3a4dd84f072f', 'created_at': datetime.datetime(2026, 7, 28, 14, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a46215a8-7d31-4833-bed6-3a4dd84f072f/file', 'properties': {}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc2a497-3a6a-45b0-ab72-8bc0aae0b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc2a497-3a6a-45b0-ab72-8bc0aae0b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce256a17-03e3-4f10-b4ff-3651eebb7634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:34 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Volume 41884534-ac56-46c4-ba1d-78026080e86c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41884534-ac56-46c4-ba1d-78026080e86c', 'volume_size': 1, 'image_id': 'a46215a8-7d31-4833-bed6-3a4dd84f072f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a46215a8-7d31-4833-bed6-3a4dd84f072f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53a7d9cb031dc1ea92f80e18ba62498f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ac35acb462d40ea864d7a56fa269c1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03920281562e49757acbeff63a878765f5f31516b39d09f0b48e38fff8b4e39c2056dad0a9b3b85e0a4162e854a7ad2a62bd391dddbe004f0ce06a77e21c4bc4', 'id': 'a46215a8-7d31-4833-bed6-3a4dd84f072f', 'created_at': datetime.datetime(2026, 7, 28, 14, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a46215a8-7d31-4833-bed6-3a4dd84f072f/file', 'properties': {}}, 'image_service': } Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Trying to clone 41884534-ac56-46c4-ba1d-78026080e86c from image a46215a8-7d31-4833-bed6-3a4dd84f072f at location (None, [{'url': 'file:///opt/stack/data/glance/images/a46215a8-7d31-4833-bed6-3a4dd84f072f', 'metadata': {}}]). {{(pid=88286) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 16:43:34 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Image download 0.00 MB at 0.00 MB/s Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[17efb15f-0dc6-44e7-9faa-202825c51eb6]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:34 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD Jul 28 16:43:34 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:34 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d 1073741824" returned: 0 in 0.699s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:34 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d Jul 28 16:43:34 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:34 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:35 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD Jul 28 16:43:35 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:35 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57bafcd-31b2-4186-9082-f722e817a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48e1fd0-3111-46b6-aa83-d90d430e3c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:35 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Volume volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d (0fefaf98-a210-41c5-9ed3-0a5493575a3d): created successfully Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48e1fd0-3111-46b6-aa83-d90d430e3c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (84217cc6-9fff-4d15-ac8e-267ed44d785c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-9ead1af2-8650-4182-abb4-3563299d0492 tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:43:35 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD" returned: 1 in 0.507s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Temporary image a46215a8-7d31-4833-bed6-3a4dd84f072f is fetched for user 24fd64e3017f41eca35a951c5e47985e. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd06d46-7e86-4400-a737-19d45a778b40]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:35 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD Jul 28 16:43:35 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:35 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=179,cinder:UPDATE=262,cinder:INSERT=67,cinder:DELETE=23 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:43:36 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD Jul 28 16:43:36 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot ba81b7f6-73da-4d01-b18f-fb5bc443bf18 of volume 0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e236c97f-b3ea-4dc1-89aa-530754baec68]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:36 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d Jul 28 16:43:36 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:36 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD" returned: 1 in 0.438s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:36 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d" returned: 0 in 0.421s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:36 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 1G Jul 28 16:43:36 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:37 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 1G" returned: 0 in 0.506s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:37 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 Jul 28 16:43:37 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:37 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18" returned: 0 in 0.345s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:37 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 is being set with open permissions: ugo+rw Jul 28 16:43:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:37 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 Jul 28 16:43:37 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:37 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18" returned: 0 in 0.300s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:37 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=193,cinder:UPDATE=251,cinder:DELETE=23,cinder:INSERT=64 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:43:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:37 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.info Jul 28 16:43:37 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:38 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.info" returned: 0 in 0.344s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:38 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.info is being set with open permissions: ugo+rw Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:38 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.info Jul 28 16:43:38 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:38 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.info" returned: 0 in 0.313s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.152s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41884534-ac56-46c4-ba1d-78026080e86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac35acb462d40ea864d7a56fa269c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:33Z,use_quota=True,user_id='24fd64e3017f41eca35a951c5e47985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Creating volume 41884534-ac56-46c4-ba1d-78026080e86c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:38 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:38 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c 1073741824 Jul 28 16:43:38 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:38 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3e539841-f45e-49c3-b6db-b9925135de97 tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Flow 'volume_create_manager' (76a21d70-6e28-49cf-8e27-548c611f1d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6574bfb2-12cc-4830-868d-ce2d2425085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6574bfb2-12cc-4830-868d-ce2d2425085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010536024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117dca2d-1829-4b9c-809b-375af3181d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830539c85ea346e8ac119b70fc39f177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:39Z,use_quota=True,user_id='6f911ff629e44363b90826b878ae9a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f9251d-537c-4e02-9461-7fff5992a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f9251d-537c-4e02-9461-7fff5992a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead80ed7-303e-47cf-995b-1d0a8e9297aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead80ed7-303e-47cf-995b-1d0a8e9297aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117dca2d-1829-4b9c-809b-375af3181d0a', 'volume_name': 'volume-117dca2d-1829-4b9c-809b-375af3181d0a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fe2329-d954-4dd2-8f77-8193081b6a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fe2329-d954-4dd2-8f77-8193081b6a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6619c9-4d4e-4929-989f-641003bea7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:39 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Volume 117dca2d-1829-4b9c-809b-375af3181d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117dca2d-1829-4b9c-809b-375af3181d0a', 'volume_size': 1} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:39 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c 1073741824" returned: 0 in 0.570s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:39 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c Jul 28 16:43:39 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-ba81b7f6-73da-4d01-b18f-fb5bc443bf18-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-ba81b7f6-73da-4d01-b18f-fb5bc443bf18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-0fefaf98-a210-41c5-9ed3-0a5493575a3d" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-0fefaf98-a210-41c5-9ed3-0a5493575a3d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-ba81b7f6-73da-4d01-b18f-fb5bc443bf18" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-ba81b7f6-73da-4d01-b18f-fb5bc443bf18" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot ba81b7f6-73da-4d01-b18f-fb5bc443bf18 of volume 0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3210cc50-9a64-4da8-828e-5b002697653e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:39 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c" returned: 0 in 0.365s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010536024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117dca2d-1829-4b9c-809b-375af3181d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830539c85ea346e8ac119b70fc39f177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:39Z,use_quota=True,user_id='6f911ff629e44363b90826b878ae9a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Creating volume 117dca2d-1829-4b9c-809b-375af3181d0a {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:39 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:39 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a 1073741824 Jul 28 16:43:39 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Attempting download of a46215a8-7d31-4833-bed6-3a4dd84f072f ((None, [{'url': 'file:///opt/stack/data/glance/images/a46215a8-7d31-4833-bed6-3a4dd84f072f', 'metadata': {}}])) to volume 41884534-ac56-46c4-ba1d-78026080e86c. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 16:43:39 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 Jul 28 16:43:39 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62849ac-d0ef-421e-af99-6657befb999b]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a46215a8-7d31-4833-bed6-3a4dd84f072f_unu6nu40 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:39 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a46215a8-7d31-4833-bed6-3a4dd84f072f_unu6nu40 Jul 28 16:43:39 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:40 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18" returned: 0 in 0.525s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eb231f-43af-4f87-9661-8ac5d8936fcf]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:40 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a46215a8-7d31-4833-bed6-3a4dd84f072f_unu6nu40" returned: 0 in 0.408s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a46215a8-7d31-4833-bed6-3a4dd84f072f_unu6nu40 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:40 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a 1073741824" returned: 0 in 0.603s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:40 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:40 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:40 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a46215a8-7d31-4833-bed6-3a4dd84f072f_unu6nu40 Jul 28 16:43:40 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:40 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a Jul 28 16:43:40 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:40 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a46215a8-7d31-4833-bed6-3a4dd84f072f_unu6nu40" returned: 1 in 0.413s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a46215a8-7d31-4833-bed6-3a4dd84f072f_unu6nu40' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:43:40 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ebc75-9f5d-48e8-b3c1-cad2a798e877]: (4, 'raw') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:40 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d" returned: 0 in 0.485s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:40 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 Jul 28 16:43:40 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6619c9-4d4e-4929-989f-641003bea7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117dca2d-1829-4b9c-809b-375af3181d0a', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e3916b-8588-4def-b2f5-2d4b06590857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:40 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Volume volume-117dca2d-1829-4b9c-809b-375af3181d0a (117dca2d-1829-4b9c-809b-375af3181d0a): created successfully Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e3916b-8588-4def-b2f5-2d4b06590857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Flow 'volume_create_manager' (76a21d70-6e28-49cf-8e27-548c611f1d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:40 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6a7055f7-818d-457d-b8eb-9799e1119e29 tempest-ProjectReaderTests-836923764 None] Created volume successfully. Jul 28 16:43:40 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD Jul 28 16:43:40 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:40 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:41 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18" returned: 0 in 0.475s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:41 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18 Jul 28 16:43:41 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:41 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD Jul 28 16:43:41 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:41 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:41 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Acquiring lock "cinder-117dca2d-1829-4b9c-809b-375af3181d0a-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Lock "cinder-117dca2d-1829-4b9c-809b-375af3181d0a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:41 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:41 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d.ba81b7f6-73da-4d01-b18f-fb5bc443bf18" returned: 0 in 0.367s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD" returned: 1 in 0.456s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD' failed. Not Retrying. {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] a46215a8-7d31-4833-bed6-3a4dd84f072f was raw, converting to qcow2 {{(pid=88286) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:41 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c Jul 28 16:43:41 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:41 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-ba81b7f6-73da-4d01-b18f-fb5bc443bf18" released by "_delete_snapshot" :: held 2.057s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Acquiring lock "cinder-quobyte-117dca2d-1829-4b9c-809b-375af3181d0a" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.401s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-0fefaf98-a210-41c5-9ed3-0a5493575a3d" released by "delete_snapshot" :: held 2.096s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Lock "cinder-quobyte-117dca2d-1829-4b9c-809b-375af3181d0a" acquired by "delete_volume" :: waited 0.038s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97eba22-ca2c-410a-9047-dd9946ccc86b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Created reservations ['31942240-fd93-4334-8f1c-d7a1e2b62bbc', '04fa4cd6-9ddb-41d5-b728-2679b9928b95', '2bb5de5f-e831-4c98-8b8f-932495a4f87b', '12a8bdce-e517-4942-b9c0-ea3c71471c1f'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:41 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:43:41 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a Jul 28 16:43:41 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:41 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfc9853f-6659-4e5b-af4a-740c4f4ecf75 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-ba81b7f6-73da-4d01-b18f-fb5bc443bf18-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:42 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c" returned: 0 in 0.597s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a46215a8-7d31-4833-bed6-3a4dd84f072f_d7n31v82devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:43:42 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:42 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c 1G Jul 28 16:43:42 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:42 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a" returned: 0 in 0.488s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:42 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a Jul 28 16:43:42 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:42 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-117dca2d-1829-4b9c-809b-375af3181d0a" returned: 0 in 0.278s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Lock "cinder-quobyte-117dca2d-1829-4b9c-809b-375af3181d0a" released by "delete_volume" :: held 0.831s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:42 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c 1G" returned: 0 in 0.414s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Downloaded image a46215a8-7d31-4833-bed6-3a4dd84f072f ((None, [{'url': 'file:///opt/stack/data/glance/images/a46215a8-7d31-4833-bed6-3a4dd84f072f', 'metadata': {}}])) to volume 41884534-ac56-46c4-ba1d-78026080e86c successfully. {{(pid=88286) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Temporary image a46215a8-7d31-4833-bed6-3a4dd84f072f for user 24fd64e3017f41eca35a951c5e47985e is deleted. {{(pid=88286) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.volume_utils [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Marking volume 41884534-ac56-46c4-ba1d-78026080e86c as bootable. {{(pid=88286) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Copying metadata from image a46215a8-7d31-4833-bed6-3a4dd84f072f to 41884534-ac56-46c4-ba1d-78026080e86c. {{(pid=88286) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Creating volume glance metadata for volume 41884534-ac56-46c4-ba1d-78026080e86c backed by image a46215a8-7d31-4833-bed6-3a4dd84f072f with: {'image_id': 'a46215a8-7d31-4833-bed6-3a4dd84f072f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '53a7d9cb031dc1ea92f80e18ba62498f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88286) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Created reservations ['54ae508a-96cb-428a-9d23-a759d9a58704', 'fbe7437b-34d5-41d9-81b9-53e868cc2f8d', 'acf4ed10-c0eb-4bdb-97ca-f45de770be20', '6dbc337b-27d8-4c22-a8e9-fb518ac9132c'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce256a17-03e3-4f10-b4ff-3651eebb7634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41884534-ac56-46c4-ba1d-78026080e86c', 'volume_size': 1, 'image_id': 'a46215a8-7d31-4833-bed6-3a4dd84f072f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a46215a8-7d31-4833-bed6-3a4dd84f072f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53a7d9cb031dc1ea92f80e18ba62498f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ac35acb462d40ea864d7a56fa269c1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03920281562e49757acbeff63a878765f5f31516b39d09f0b48e38fff8b4e39c2056dad0a9b3b85e0a4162e854a7ad2a62bd391dddbe004f0ce06a77e21c4bc4', 'id': 'a46215a8-7d31-4833-bed6-3a4dd84f072f', 'created_at': datetime.datetime(2026, 7, 28, 14, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 14, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a46215a8-7d31-4833-bed6-3a4dd84f072f/file', 'properties': {}}, 'image_service': }' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85adf282-8579-40a1-acb7-71faf2d0449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:42 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:42 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:42 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Volume volume-41884534-ac56-46c4-ba1d-78026080e86c (41884534-ac56-46c4-ba1d-78026080e86c): created successfully Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85adf282-8579-40a1-acb7-71faf2d0449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Flow 'volume_create_manager' (e58064ff-c2fd-492e-82e1-53b89fbd7851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:42 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-725852fa-62f1-41e0-9690-542012ee6584 tempest-VolumeImageDependencyTests-588041716 None] Created volume successfully. Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-0fefaf98-a210-41c5-9ed3-0a5493575a3d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-0fefaf98-a210-41c5-9ed3-0a5493575a3d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-0fefaf98-a210-41c5-9ed3-0a5493575a3d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-0fefaf98-a210-41c5-9ed3-0a5493575a3d" acquired by "delete_volume" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[938d2547-6383-430d-be71-974da3cf6ece]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:43 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.400s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:43 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d Jul 28 16:43:43 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:43 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Deleted volume successfully. Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1b538cb1-bb96-4d2e-b4e0-ce804621719b tempest-ProjectReaderTests-836923764 None] Lock "cinder-117dca2d-1829-4b9c-809b-375af3181d0a-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Acquiring lock "cinder-41884534-ac56-46c4-ba1d-78026080e86c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Lock "cinder-41884534-ac56-46c4-ba1d-78026080e86c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Acquiring lock "cinder-quobyte-41884534-ac56-46c4-ba1d-78026080e86c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Lock "cinder-quobyte-41884534-ac56-46c4-ba1d-78026080e86c" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc847f7-aece-4dae-b6ae-0cf33ad1d6cd]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:43 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d" returned: 0 in 0.441s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:43 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c Jul 28 16:43:43 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:43 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d Jul 28 16:43:43 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:43 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-0fefaf98-a210-41c5-9ed3-0a5493575a3d" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:43 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-0fefaf98-a210-41c5-9ed3-0a5493575a3d" released by "delete_volume" :: held 0.855s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c" returned: 0 in 0.476s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:43 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c Jul 28 16:43:43 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Created reservations ['c1d35c75-1957-4d4a-b222-681ab8ea2ccd', '6a82bb71-8468-4ff8-9dc2-491c6b843527', '1221a611-b985-4b70-a2cf-afc7b003ac29', '1bb0914f-da28-4e74-9e6f-5072d9154a3a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:44 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:44 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:44 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-41884534-ac56-46c4-ba1d-78026080e86c" returned: 0 in 0.501s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Lock "cinder-quobyte-41884534-ac56-46c4-ba1d-78026080e86c" released by "delete_volume" :: held 1.037s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:44 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.434s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Created reservations ['11209cc4-200f-4bc4-9e23-b47f06c8f2c1', '53ff5953-26d1-41fb-b0ee-05c29d5b2dd8', 'ccb240e1-a1bd-4df2-86a7-1cbfb9d2311a', '6695ecab-23ab-4714-988b-48dde66c8617'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Flow 'volume_create_manager' (16c25e01-1948-479a-9996-9681e37105ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea6bc79-5438-491b-a186-0cd4883216d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea6bc79-5438-491b-a186-0cd4883216d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219486530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830539c85ea346e8ac119b70fc39f177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:44Z,use_quota=True,user_id='6f911ff629e44363b90826b878ae9a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbd3763-8836-4481-a469-7550f836ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbd3763-8836-4481-a469-7550f836ae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a568df53-6263-4e90-b987-56deaad825f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a568df53-6263-4e90-b987-56deaad825f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7', 'volume_name': 'volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9653cce6-94ec-40ba-a957-a3e116500775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9653cce6-94ec-40ba-a957-a3e116500775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fb60cf-3fa2-488a-a73a-a5fd1bccf2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Volume 3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7', 'volume_size': 1} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219486530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830539c85ea346e8ac119b70fc39f177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:44Z,use_quota=True,user_id='6f911ff629e44363b90826b878ae9a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Creating volume 3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:44 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:44 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 1073741824 Jul 28 16:43:44 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-174bc73b-7f91-4816-9175-6430c8fe82a4 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-0fefaf98-a210-41c5-9ed3-0a5493575a3d-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:44 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:44 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (55d3043f-e64f-4094-b38c-b05fed036925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b111df-f79a-433e-bb1b-3f905a9817e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b111df-f79a-433e-bb1b-3f905a9817e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602937408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c5af9a-29ed-4088-8c05-77f8143a6a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:45Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e81407-308c-4aa1-8e2a-22eb69db9676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e81407-308c-4aa1-8e2a-22eb69db9676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65213f8d-54e6-4129-9510-7758206631db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65213f8d-54e6-4129-9510-7758206631db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c5af9a-29ed-4088-8c05-77f8143a6a9d', 'volume_name': 'volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c275d14-4541-44f7-ac63-027da7222763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c275d14-4541-44f7-ac63-027da7222763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a66158b-56c2-4adf-a407-91974030a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Volume 02c5af9a-29ed-4088-8c05-77f8143a6a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d', 'volume_size': 1} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:44 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Deleted volume successfully. Jul 28 16:43:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-1efa8d99-c76c-4a67-b3ed-b79cffa8598b tempest-VolumeImageDependencyTests-588041716 None] Lock "cinder-41884534-ac56-46c4-ba1d-78026080e86c-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:45 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 1073741824" returned: 0 in 0.561s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:45 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 Jul 28 16:43:45 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:45 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602937408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c5af9a-29ed-4088-8c05-77f8143a6a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:45Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Creating volume 02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:45 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fb60cf-3fa2-488a-a73a-a5fd1bccf2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:45 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d 1073741824 Jul 28 16:43:45 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31468f8-b66c-4c8d-b3aa-4dc90bd43a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:45 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Volume volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 (3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7): created successfully Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31468f8-b66c-4c8d-b3aa-4dc90bd43a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:45 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Flow 'volume_create_manager' (16c25e01-1948-479a-9996-9681e37105ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e826854f-fe69-4ab4-ba77-0b0f7993618b tempest-ProjectReaderTests-836923764 None] Created volume successfully. Jul 28 16:43:46 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d 1073741824" returned: 0 in 0.601s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:46 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d Jul 28 16:43:46 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:46 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d" returned: 0 in 0.311s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a66158b-56c2-4adf-a407-91974030a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54950765-6d2c-4c64-b693-56945ec31cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Volume volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d (02c5af9a-29ed-4088-8c05-77f8143a6a9d): created successfully Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54950765-6d2c-4c64-b693-56945ec31cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (55d3043f-e64f-4094-b38c-b05fed036925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Acquiring lock "cinder-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4023413a-3fa3-4599-9be3-4fa8b8e90577 tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Lock "cinder-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Acquiring lock "cinder-quobyte-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Lock "cinder-quobyte-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7" acquired by "delete_volume" :: waited 0.044s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f23a196-d4ab-40de-a093-0e75f559f498]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:46 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 Jul 28 16:43:46 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 of volume 02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ee717-14ee-40f0-9786-30bddcc580e9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:47 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7" returned: 0 in 0.573s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:47 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7 Jul 28 16:43:47 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:47 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d Jul 28 16:43:47 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:47 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7" returned: 0 in 0.369s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Lock "cinder-quobyte-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7" released by "delete_volume" :: held 1.029s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:47 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d" returned: 0 in 0.526s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:47 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 1G Jul 28 16:43:47 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Created reservations ['d0f40231-1207-47eb-b5c1-8b7a4d5e4508', '6f7ee04e-85f7-48db-95a6-821be0538072', 'afb576af-763a-4feb-994d-d89e05f58d9b', 'e20cbccb-ff82-4313-9843-98f8e531a7ea'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:48 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:48 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:48 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 1G" returned: 0 in 0.633s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:48 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:48 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 Jul 28 16:43:48 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.356s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:48 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Deleted volume successfully. Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-18a7e616-0430-487e-816f-03b54f763c89 tempest-ProjectReaderTests-836923764 None] Lock "cinder-3887a884-8ef9-4a1f-9eb5-bd86c2f52ba7-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:48 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" returned: 0 in 0.380s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:48 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 is being set with open permissions: ugo+rw Jul 28 16:43:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:48 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 Jul 28 16:43:48 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:49 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:49 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.info Jul 28 16:43:49 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:49 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.info" returned: 0 in 0.354s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:49 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.info is being set with open permissions: ugo+rw Jul 28 16:43:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:49 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.info Jul 28 16:43:49 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:49 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.info" returned: 0 in 0.325s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:49 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-15b9fe5d-2541-4e9a-b3ba-d22d7005590b tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Flow 'volume_create_manager' (081f2bc1-8517-48aa-966b-c4140147985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443e5131-51f2-431a-b0fe-a6a3ebd505b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443e5131-51f2-431a-b0fe-a6a3ebd505b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd6da02-88fa-4651-882f-01fe5adbe176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1448719c8240ac81f321687dca438c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:50Z,use_quota=True,user_id='c068621d2ab347ae939e619a160a11c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bf6fa5-98ec-4734-965a-cb14ed05898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bf6fa5-98ec-4734-965a-cb14ed05898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4892c87-5e97-4279-951c-04586602fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4892c87-5e97-4279-951c-04586602fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd6da02-88fa-4651-882f-01fe5adbe176', 'volume_name': 'volume-3fd6da02-88fa-4651-882f-01fe5adbe176', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da053180-fbc8-4e28-9fdf-9717e6c3fbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da053180-fbc8-4e28-9fdf-9717e6c3fbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c0c81f-d29a-49fd-bb15-39b9b8b2441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:50 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Volume 3fd6da02-88fa-4651-882f-01fe5adbe176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd6da02-88fa-4651-882f-01fe5adbe176', 'volume_size': 1} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd6da02-88fa-4651-882f-01fe5adbe176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1448719c8240ac81f321687dca438c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:50Z,use_quota=True,user_id='c068621d2ab347ae939e619a160a11c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Creating volume 3fd6da02-88fa-4651-882f-01fe5adbe176 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:50 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:50 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 1073741824 Jul 28 16:43:50 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-02c5af9a-29ed-4088-8c05-77f8143a6a9d" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-02c5af9a-29ed-4088-8c05-77f8143a6a9d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 of volume 02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f70f400-02a7-4a32-8db3-75c55293b884]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:50 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 Jul 28 16:43:50 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:50 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 1073741824" returned: 0 in 0.679s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:51 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 Jul 28 16:43:51 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:51 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" returned: 0 in 0.645s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb7efd4-f07b-4140-bce4-793a7569da8b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:51 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d Jul 28 16:43:51 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:51 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176" returned: 0 in 0.333s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c0c81f-d29a-49fd-bb15-39b9b8b2441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd6da02-88fa-4651-882f-01fe5adbe176', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695a0a5f-54db-4cce-bbeb-5d33e9898a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:51 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Volume volume-3fd6da02-88fa-4651-882f-01fe5adbe176 (3fd6da02-88fa-4651-882f-01fe5adbe176): created successfully Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695a0a5f-54db-4cce-bbeb-5d33e9898a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Flow 'volume_create_manager' (081f2bc1-8517-48aa-966b-c4140147985d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:51 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-80e3e02e-37c2-432e-b9d2-10e7bae21ff4 tempest-CinderUnicodeTest-46407270 None] Created volume successfully. Jul 28 16:43:51 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d" returned: 0 in 0.511s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:51 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:51 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 Jul 28 16:43:51 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:52 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" returned: 0 in 0.412s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:52 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7 Jul 28 16:43:52 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:52 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d.d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" returned: 0 in 0.316s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7" released by "_delete_snapshot" :: held 2.005s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-02c5af9a-29ed-4088-8c05-77f8143a6a9d" released by "delete_snapshot" :: held 2.035s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:52 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Created reservations ['7fb62376-5ac8-4021-b90d-09bb03a1eb02', 'b74558af-f240-4eb8-ac9a-62d0c4b62359', 'fc5afe86-5e3e-4325-b854-bf037fec7d6c', '7ecf281f-0d01-447e-a1e3-5fbe1812d39a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:52 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:43:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-44469fe7-0d3b-4ba5-b9b9-26fe0fb9ea39 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-d5db7b51-0c40-4f18-8bd4-e0a9a658fcc7-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Flow 'volume_create_manager' (8b178385-5844-435c-9be2-5bf9b9acb94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89a9711-d3b2-4ce9-9ea1-a1a91d49ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89a9711-d3b2-4ce9-9ea1-a1a91d49ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-755247295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6e8388-36d8-4d74-9e0e-0ce13d34c374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1448719c8240ac81f321687dca438c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:53Z,use_quota=True,user_id='c068621d2ab347ae939e619a160a11c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34102eee-e6b0-4006-af6f-d5d712deb0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34102eee-e6b0-4006-af6f-d5d712deb0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128311d7-36c5-4378-b3cd-792a72bd3c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128311d7-36c5-4378-b3cd-792a72bd3c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6e8388-36d8-4d74-9e0e-0ce13d34c374', 'volume_name': 'volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f533379f-60a4-4774-9d33-730d558a35fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f533379f-60a4-4774-9d33-730d558a35fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff91b279-b6e8-41a3-a977-ab9de6ee1c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:53 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Volume cb6e8388-36d8-4d74-9e0e-0ce13d34c374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374', 'volume_size': 1} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-755247295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6e8388-36d8-4d74-9e0e-0ce13d34c374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1448719c8240ac81f321687dca438c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:53Z,use_quota=True,user_id='c068621d2ab347ae939e619a160a11c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Creating volume cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:53 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:53 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 1073741824 Jul 28 16:43:53 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-02c5af9a-29ed-4088-8c05-77f8143a6a9d-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:53 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 1073741824" returned: 0 in 0.614s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Lock "cinder-02c5af9a-29ed-4088-8c05-77f8143a6a9d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:53 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 Jul 28 16:43:53 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-02c5af9a-29ed-4088-8c05-77f8143a6a9d" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-02c5af9a-29ed-4088-8c05-77f8143a6a9d" acquired by "delete_volume" :: waited 0.031s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f12e6-835a-4c85-9138-e1bf52c33844]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:54 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d Jul 28 16:43:54 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:54 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" returned: 0 in 0.470s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff91b279-b6e8-41a3-a977-ab9de6ee1c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c8ed95-b41f-4909-88a7-63db6b5b8d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:54 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Volume volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 (cb6e8388-36d8-4d74-9e0e-0ce13d34c374): created successfully Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c8ed95-b41f-4909-88a7-63db6b5b8d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Flow 'volume_create_manager' (8b178385-5844-435c-9be2-5bf9b9acb94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:54 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7e2d1dd4-2061-4897-ae4d-4979aa2b975f tempest-CinderUnicodeTest-46407270 None] Created volume successfully. Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:54 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (f2dfa298-d4b1-40be-b721-4616091e05a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6260dd-77fd-4d37-aa61-d47d2a9839ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d" returned: 0 in 0.565s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6260dd-77fd-4d37-aa61-d47d2a9839ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986285306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee9570-5b38-46a6-8de2-4676914867cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:54Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b94ebe1-ba6e-48da-88e6-abfc46c00da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:54 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d Jul 28 16:43:54 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b94ebe1-ba6e-48da-88e6-abfc46c00da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32ef307-e4fd-4dba-bc48-8bfce3a2bbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32ef307-e4fd-4dba-bc48-8bfce3a2bbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ee9570-5b38-46a6-8de2-4676914867cb', 'volume_name': 'volume-04ee9570-5b38-46a6-8de2-4676914867cb', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75287adb-6c61-40bd-bf0d-55c875df1f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75287adb-6c61-40bd-bf0d-55c875df1f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025af1cb-3e35-4386-b0ab-2b19b6b009d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:54 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Volume 04ee9570-5b38-46a6-8de2-4676914867cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ee9570-5b38-46a6-8de2-4676914867cb', 'volume_size': 1} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986285306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee9570-5b38-46a6-8de2-4676914867cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:54Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Creating volume 04ee9570-5b38-46a6-8de2-4676914867cb {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:54 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:54 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb 1073741824 Jul 28 16:43:54 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:54 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-02c5af9a-29ed-4088-8c05-77f8143a6a9d" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-02c5af9a-29ed-4088-8c05-77f8143a6a9d" released by "delete_volume" :: held 0.987s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:54 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Created reservations ['515a2a6e-e58c-4d17-bb9f-b6df0a25ccc7', '5cebfa98-7fd4-42aa-aef8-8033b8e643a6', '3683f21f-c948-45ee-81fa-c170ad1e64f6', '86e63c0c-ab0e-4277-a1bb-829963cc20cb'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:55 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:55 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:55 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb 1073741824" returned: 0 in 0.578s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:55 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb Jul 28 16:43:55 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:55 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.302s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fc8b09b0-6994-4f48-895a-f692ed3067ad tempest-ProjectMemberTests-1589750625 None] Lock "cinder-02c5af9a-29ed-4088-8c05-77f8143a6a9d-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:55 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.090s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Creating offline snapshot c9fc4fb5-fb55-4876-b085-4ab6cc070c72 of volume cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025af1cb-3e35-4386-b0ab-2b19b6b009d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ee9570-5b38-46a6-8de2-4676914867cb', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2ea73c-04fa-437c-a67e-5396de7aac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[af793933-2108-40c2-8605-d6a6b1f1200b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:55 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Volume volume-04ee9570-5b38-46a6-8de2-4676914867cb (04ee9570-5b38-46a6-8de2-4676914867cb): created successfully Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2ea73c-04fa-437c-a67e-5396de7aac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (f2dfa298-d4b1-40be-b721-4616091e05a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-976e3e74-9b6e-4a7a-99bf-05129665966c tempest-ProjectReaderTests-1761734348 None] Created volume successfully. Jul 28 16:43:55 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 Jul 28 16:43:55 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:56 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" returned: 0 in 0.408s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:56 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 1G Jul 28 16:43:56 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:56 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 1G" returned: 0 in 0.561s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:56 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 Jul 28 16:43:56 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (6fd99955-fc0b-4374-bc25-88d66503fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8b21d4-09f8-4696-9cbf-512fe777c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8b21d4-09f8-4696-9cbf-512fe777c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339778101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c39b520-cfe3-4d3b-b4a5-f4a073578232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:57Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54569b32-73eb-4af8-b77f-2b50e5239f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54569b32-73eb-4af8-b77f-2b50e5239f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f2b701-18cf-4af0-a4bd-5f19a7476791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f2b701-18cf-4af0-a4bd-5f19a7476791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c39b520-cfe3-4d3b-b4a5-f4a073578232', 'volume_name': 'volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5688e0da-d453-4e7f-a951-f12dd7377b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5688e0da-d453-4e7f-a951-f12dd7377b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070c8ead-2ca0-43fc-a043-30fa3cedff44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:56 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Volume 2c39b520-cfe3-4d3b-b4a5-f4a073578232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232', 'volume_size': 1} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-04ee9570-5b38-46a6-8de2-4676914867cb-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Lock "cinder-04ee9570-5b38-46a6-8de2-4676914867cb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-quobyte-04ee9570-5b38-46a6-8de2-4676914867cb" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-04ee9570-5b38-46a6-8de2-4676914867cb" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef333d6f-83e2-4b9b-94c1-86ee4d423f78]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:57 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72" returned: 0 in 0.437s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:57 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 is being set with open permissions: ugo+rw Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:57 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 Jul 28 16:43:57 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:57 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb Jul 28 16:43:57 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:57 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72" returned: 0 in 0.265s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:57 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.info Jul 28 16:43:57 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:57 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb" returned: 0 in 0.416s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:57 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb Jul 28 16:43:57 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:57 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.info" returned: 0 in 0.334s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:57 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.info is being set with open permissions: ugo+rw Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:57 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.info Jul 28 16:43:57 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:57 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-04ee9570-5b38-46a6-8de2-4676914867cb" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-04ee9570-5b38-46a6-8de2-4676914867cb" released by "delete_volume" :: held 0.781s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Created reservations ['dee3ac62-605e-42e9-9eb5-9ec4dfa6b00a', '91209b95-d9b6-4b2f-bbc0-376ed906e041', '540a5678-0b71-4fec-8ff5-e39502bcd1bd', '7854f420-beb1-40e8-a368-8e923c69642b'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:57 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:43:57 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:57 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.info" returned: 0 in 0.279s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339778101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c39b520-cfe3-4d3b-b4a5-f4a073578232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:57Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Creating volume 2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:57 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:57 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 1073741824 Jul 28 16:43:58 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1005beae-79fe-4d6c-a136-d1fcbb0e1f38 tempest-CinderUnicodeTest-46407270 None] Create snapshot completed successfully Jul 28 16:43:58 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:43:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Deleted volume successfully. Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6199dac7-f2a4-4819-91e1-ee8360ae4b07 tempest-ProjectReaderTests-1761734348 None] Lock "cinder-04ee9570-5b38-46a6-8de2-4676914867cb-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:43:58 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 1073741824" returned: 0 in 0.545s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:58 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 Jul 28 16:43:58 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "cinder-c9fc4fb5-fb55-4876-b085-4ab6cc070c72-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-c9fc4fb5-fb55-4876-b085-4ab6cc070c72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "cinder-quobyte-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (fe5a101a-7d7e-47e3-9790-76a3c25bad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2704752-9d1b-46c5-9e0d-d3e265fd2291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" acquired by "delete_snapshot" :: waited 0.084s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "cinder-quobyte-c9fc4fb5-fb55-4876-b085-4ab6cc070c72" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2704752-9d1b-46c5-9e0d-d3e265fd2291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031845062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9c8e00-7526-46fd-8cdc-95c663f333c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:59Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10124e36-c2c8-45a6-896b-2d322f7722c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10124e36-c2c8-45a6-896b-2d322f7722c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26bdc56-39ef-450d-9196-959fd750c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26bdc56-39ef-450d-9196-959fd750c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9c8e00-7526-46fd-8cdc-95c663f333c6', 'volume_name': 'volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480de603-a978-4b4f-a706-36a02c8e06c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480de603-a978-4b4f-a706-36a02c8e06c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d9b4b5-3e01-4dc9-a371-fbfab4fc3652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:58 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Volume 7e9c8e00-7526-46fd-8cdc-95c663f333c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6', 'volume_size': 1} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-c9fc4fb5-fb55-4876-b085-4ab6cc070c72" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Deleting offline snapshot c9fc4fb5-fb55-4876-b085-4ab6cc070c72 of volume cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] snapshot_file for this snap is: volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44b00cd-2d13-4cc5-9d22-184e77f5214d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:58 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232" returned: 0 in 0.397s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031845062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9c8e00-7526-46fd-8cdc-95c663f333c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:43:59Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Creating volume 7e9c8e00-7526-46fd-8cdc-95c663f333c6 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:43:58 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:43:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070c8ead-2ca0-43fc-a043-30fa3cedff44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:59 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 1073741824 Jul 28 16:43:59 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51030e12-32d9-4fe8-a48c-b9d2eba8acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:59 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Volume volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 (2c39b520-cfe3-4d3b-b4a5-f4a073578232): created successfully Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51030e12-32d9-4fe8-a48c-b9d2eba8acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (6fd99955-fc0b-4374-bc25-88d66503fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-783fc2bf-7e7c-4ae8-a871-80fbf9cefdd5 tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:43:59 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 Jul 28 16:43:59 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:59 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72" returned: 0 in 0.425s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56587b0-f3c2-4e9d-9527-8eb49a72ab2b]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:59 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 1073741824" returned: 0 in 0.497s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:59 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 Jul 28 16:43:59 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:59 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 Jul 28 16:43:59 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:59 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" returned: 0 in 0.429s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:43:59 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:43:59 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d9b4b5-3e01-4dc9-a371-fbfab4fc3652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fb6bd1-dd8d-4b5e-8e18-40456d7dd08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:43:59 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Volume volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 (7e9c8e00-7526-46fd-8cdc-95c663f333c6): created successfully Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fb6bd1-dd8d-4b5e-8e18-40456d7dd08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:43:59 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:43:59 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (fe5a101a-7d7e-47e3-9790-76a3c25bad44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:43:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-1eaebb39-1d7c-447a-b6d3-83c90d6cd24a tempest-ProjectReaderTests-1761734348 None] Created volume successfully. Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot 69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 of volume 2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcaeb5d-b340-408b-a6bb-52aeae93f658]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:00 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 Jul 28 16:44:00 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:00 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72" returned: 0 in 0.530s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:00 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72 Jul 28 16:44:00 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:00 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:00 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374.c9fc4fb5-fb55-4876-b085-4ab6cc070c72" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:00 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 1G Jul 28 16:44:00 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-c9fc4fb5-fb55-4876-b085-4ab6cc070c72" released by "_delete_snapshot" :: held 1.807s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" released by "delete_snapshot" :: held 1.878s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-7e9c8e00-7526-46fd-8cdc-95c663f333c6-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Created reservations ['b01236cb-ade7-4a16-a80a-a4706d79b389', '5c665d4a-701a-4aca-a4a3-93b544deb54e', 'f80cff7d-5c7b-4e62-b988-16dd35f371eb', 'a4bf4b4a-c64a-459b-a8a6-174d475be845'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Lock "cinder-7e9c8e00-7526-46fd-8cdc-95c663f333c6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-quobyte-7e9c8e00-7526-46fd-8cdc-95c663f333c6" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-7e9c8e00-7526-46fd-8cdc-95c663f333c6" acquired by "delete_volume" :: waited 0.034s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Delete snapshot completed successfully. Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-173795cd-eb99-4545-8af5-60b73272bb03 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-c9fc4fb5-fb55-4876-b085-4ab6cc070c72-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef85b785-8d11-444e-9d61-e0ec8e8fbf6c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:01 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 Jul 28 16:44:01 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:01 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 1G" returned: 0 in 0.575s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:01 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 Jul 28 16:44:01 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:01 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6" returned: 0 in 0.399s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:01 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6 Jul 28 16:44:01 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:01 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" returned: 0 in 0.334s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:01 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 is being set with open permissions: ugo+rw Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:01 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 Jul 28 16:44:01 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:01 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-7e9c8e00-7526-46fd-8cdc-95c663f333c6" returned: 0 in 0.283s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-7e9c8e00-7526-46fd-8cdc-95c663f333c6" released by "delete_volume" :: held 0.732s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Created reservations ['68ae3554-9a64-4c87-808c-72ccd80b5697', '95b53866-c68a-4cae-8d81-11952ae4db10', '94bcab69-6c8b-4f96-a403-ddd93a3a5810', 'b84dab2c-2d6c-4b64-ad14-94c2afe148bc'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:01 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" returned: 0 in 0.279s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:01 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.info Jul 28 16:44:01 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:01 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:01 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "cinder-cb6e8388-36d8-4d74-9e0e-0ce13d34c374-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-cb6e8388-36d8-4d74-9e0e-0ce13d34c374-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "cinder-quobyte-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fedefd-f1f7-4273-86de-11ce9fdb3392]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:02 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.info" returned: 0 in 0.373s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:02 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.info is being set with open permissions: ugo+rw Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:02 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.info Jul 28 16:44:02 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:02 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 Jul 28 16:44:02 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:02 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.392s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Deleted volume successfully. Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7351c2d8-e8a7-47d6-871d-c1418a4f08ec tempest-ProjectReaderTests-1761734348 None] Lock "cinder-7e9c8e00-7526-46fd-8cdc-95c663f333c6-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:02 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.info" returned: 0 in 0.363s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:02 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" returned: 0 in 0.525s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:02 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-666f7855-f31a-4a7c-b109-6354b5dace93 tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:02 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374 Jul 28 16:44:02 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (98596706-1137-4809-b95f-c237685c70af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e414c8-02d9-4128-a0d3-8272d330f503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e414c8-02d9-4128-a0d3-8272d330f503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1933672399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9409c5-c2d6-44f4-8171-843d4211ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:03Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84ef26d-e7dd-4fd6-9c98-0f9f9655e499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84ef26d-e7dd-4fd6-9c98-0f9f9655e499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd4693b-32db-4534-aa0d-20b10face73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd4693b-32db-4534-aa0d-20b10face73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9409c5-c2d6-44f4-8171-843d4211ec95', 'volume_name': 'volume-5e9409c5-c2d6-44f4-8171-843d4211ec95', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0214fca-4924-4b85-b944-78ef6d81be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0214fca-4924-4b85-b944-78ef6d81be3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d992383-d0c4-4c6e-bbba-71c61852b938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:02 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Volume 5e9409c5-c2d6-44f4-8171-843d4211ec95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9409c5-c2d6-44f4-8171-843d4211ec95', 'volume_size': 1} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1933672399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9409c5-c2d6-44f4-8171-843d4211ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:03Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Creating volume 5e9409c5-c2d6-44f4-8171-843d4211ec95 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:44:02 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:02 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 1073741824 Jul 28 16:44:02 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:02 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-cb6e8388-36d8-4d74-9e0e-0ce13d34c374" released by "delete_volume" :: held 0.935s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Created reservations ['e87a3393-520f-4823-9e6f-f3b01a66e3c7', 'b8eba25e-0ce9-4461-af0d-b96dad7d4195', 'a79582fd-7eb6-4266-aba5-bfb521f07543', 'f6a9567f-4b49-4d7a-965a-dad4cccb4c19'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:03 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:03 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "cinder-3fd6da02-88fa-4651-882f-01fe5adbe176-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-3fd6da02-88fa-4651-882f-01fe5adbe176-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-2c39b520-cfe3-4d3b-b4a5-f4a073578232" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "cinder-quobyte-3fd6da02-88fa-4651-882f-01fe5adbe176" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-2c39b520-cfe3-4d3b-b4a5-f4a073578232" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-3fd6da02-88fa-4651-882f-01fe5adbe176" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot 69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 of volume 2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[86193b2d-6052-4067-b8bc-aadaa63f1ed8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08ed524-c8f6-438f-a85f-32852c5a0068]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:03 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 1073741824" returned: 0 in 0.709s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:03 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.443s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:03 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Deleted volume successfully. Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-10f742e0-8cff-4587-9866-54b992432ce7 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-cb6e8388-36d8-4d74-9e0e-0ce13d34c374-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:03 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 Jul 28 16:44:03 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:03 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 Jul 28 16:44:03 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:03 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 Jul 28 16:44:03 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:03 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95" returned: 0 in 0.359s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:44:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d992383-d0c4-4c6e-bbba-71c61852b938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9409c5-c2d6-44f4-8171-843d4211ec95', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b1b7eb-5630-4871-88f0-954fbb143fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:04 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176" returned: 0 in 0.481s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:04 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Volume volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 (5e9409c5-c2d6-44f4-8171-843d4211ec95): created successfully Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b1b7eb-5630-4871-88f0-954fbb143fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:04 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176 Jul 28 16:44:04 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (98596706-1137-4809-b95f-c237685c70af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:04 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" returned: 0 in 0.521s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:44:04 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fda9372e-bf04-4c79-a90b-b86ed0fad490 tempest-ProjectReaderTests-1761734348 None] Created volume successfully. Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d6950e-0ffd-4541-9f82-8eb354cf14d3]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:04 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 Jul 28 16:44:04 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:04 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3fd6da02-88fa-4651-882f-01fe5adbe176" returned: 0 in 0.331s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-quobyte-3fd6da02-88fa-4651-882f-01fe5adbe176" released by "delete_volume" :: held 0.908s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Created reservations ['c379c251-5b21-41ae-b672-481153733e65', 'f7a2140f-bf5f-48f2-846d-e6cea11deba3', 'e45d96a6-f355-4675-bcd9-ef4d8edcd826', 'aff90415-5472-4e04-ac4d-82d64a051979'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:04 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232" returned: 0 in 0.454s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:04 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:04 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:04 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 Jul 28 16:44:04 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:04 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.333s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:04 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Deleted volume successfully. Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b0c578f7-b857-4005-9aa9-c6c308e62470 tempest-CinderUnicodeTest-46407270 None] Lock "cinder-3fd6da02-88fa-4651-882f-01fe5adbe176-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-5e9409c5-c2d6-44f4-8171-843d4211ec95-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:04 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Lock "cinder-5e9409c5-c2d6-44f4-8171-843d4211ec95-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" returned: 0 in 0.426s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:05 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252 Jul 28 16:44:05 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-quobyte-5e9409c5-c2d6-44f4-8171-843d4211ec95" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-5e9409c5-c2d6-44f4-8171-843d4211ec95" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a6bd2e-56fd-495c-b0c7-aae1232f187a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:05 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 Jul 28 16:44:05 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:05 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232.69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252" released by "_delete_snapshot" :: held 1.848s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-2c39b520-cfe3-4d3b-b4a5-f4a073578232" released by "delete_snapshot" :: held 1.903s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Created reservations ['14603509-3dbf-4d38-bb2e-2ac37eef167f', '320a1552-56c7-4503-8e2a-349abf3cad0a', 'afa265bb-84d7-4215-b6ce-67b603f43e4c', '6e526d00-ffe1-4e47-877b-0a45a35ee6bc'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:05 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0b6cda0-adff-46d8-a3e5-9930bfdf3989 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-69dc3dd4-5cd9-4aa3-bfff-717eb1bfd252-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:05 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95" returned: 0 in 0.492s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-2c39b520-cfe3-4d3b-b4a5-f4a073578232-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Lock "cinder-2c39b520-cfe3-4d3b-b4a5-f4a073578232-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:05 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95 Jul 28 16:44:05 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-2c39b520-cfe3-4d3b-b4a5-f4a073578232" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-2c39b520-cfe3-4d3b-b4a5-f4a073578232" acquired by "delete_volume" :: waited 0.040s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c1626-7560-4df4-ab17-419c24b60edf]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:05 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:05 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 Jul 28 16:44:05 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:05 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-5e9409c5-c2d6-44f4-8171-843d4211ec95" returned: 0 in 0.381s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-5e9409c5-c2d6-44f4-8171-843d4211ec95" released by "delete_volume" :: held 0.935s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Created reservations ['7d6a00ca-6584-41c6-bc98-e59bde74bfb4', '9102c401-291c-4e18-a786-6c0d0dd1983e', 'f00da741-324e-4468-8d59-710a6d97ac81', '2a51b9bb-a397-4ea8-973f-6a0bbce86abe'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:06 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:06 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:06 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232" returned: 0 in 0.494s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:06 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232 Jul 28 16:44:06 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:06 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.362s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:06 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Deleted volume successfully. Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2df9f305-acee-4011-9756-3fe368c9088d tempest-ProjectReaderTests-1761734348 None] Lock "cinder-5e9409c5-c2d6-44f4-8171-843d4211ec95-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:06 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-2c39b520-cfe3-4d3b-b4a5-f4a073578232" returned: 0 in 0.357s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-2c39b520-cfe3-4d3b-b4a5-f4a073578232" released by "delete_volume" :: held 0.941s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Created reservations ['17c01442-09ac-48f1-8b99-be4b4b4bf47a', '0675c394-adb4-4a78-af93-3ff59aebf33c', '9e242f58-1747-4bec-bbca-c1fd59ab6ca5', '4d23b82b-165a-40ae-a7c9-aad4b2859cfd'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:06 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:06 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:07 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.322s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c3fef444-06f6-4475-b1d5-74385d44aaaa tempest-ProjectMemberTests-1589750625 None] Lock "cinder-2c39b520-cfe3-4d3b-b4a5-f4a073578232-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (1319841c-789c-4059-a8a9-f997aef4ea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9170bd09-7031-4753-9157-6a995951b318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9170bd09-7031-4753-9157-6a995951b318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542042594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa61fbb-ea75-4cec-8aae-d0737bfbad70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:08Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a181d8f-df84-4382-b679-fab0e559c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a181d8f-df84-4382-b679-fab0e559c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbafa082-3e29-492a-a711-97a5d7b068ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbafa082-3e29-492a-a711-97a5d7b068ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa61fbb-ea75-4cec-8aae-d0737bfbad70', 'volume_name': 'volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5df90e-a26d-4c73-a66a-eee10a697ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5df90e-a26d-4c73-a66a-eee10a697ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ee79e2-c0b2-431e-8869-3c82e9b05976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:07 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Volume 3aa61fbb-ea75-4cec-8aae-d0737bfbad70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70', 'volume_size': 1} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542042594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa61fbb-ea75-4cec-8aae-d0737bfbad70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2f0e37b9ab4449b7235ba868e3cb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:08Z,use_quota=True,user_id='21903a365fe44c7aafb50e6dad65c794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Creating volume 3aa61fbb-ea75-4cec-8aae-d0737bfbad70 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:44:07 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:44:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:08 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 1073741824 Jul 28 16:44:08 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:44:08 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (56ddbce7-3e47-4836-bbf0-993ade26d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c795b5-50ee-4595-9685-55fb532c7d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 1073741824" returned: 0 in 0.665s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c795b5-50ee-4595-9685-55fb532c7d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526381971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3268c7-e839-435d-9487-1d659f102291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:09Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af40531-c2c0-4a50-b6e6-a35a8d8e87d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af40531-c2c0-4a50-b6e6-a35a8d8e87d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8a4337-f5a1-4073-aee7-9579e3b05e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8a4337-f5a1-4073-aee7-9579e3b05e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3268c7-e839-435d-9487-1d659f102291', 'volume_name': 'volume-6d3268c7-e839-435d-9487-1d659f102291', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced59149-e549-422e-9551-a863aae5cce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced59149-e549-422e-9551-a863aae5cce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c30f589-7dfa-44c0-a95c-6fcd2f4763b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:08 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Volume 6d3268c7-e839-435d-9487-1d659f102291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3268c7-e839-435d-9487-1d659f102291', 'volume_size': 1} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:08 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 Jul 28 16:44:08 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:09 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70" returned: 0 in 0.301s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526381971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3268c7-e839-435d-9487-1d659f102291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:09Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Creating volume 6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:44:09 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ee79e2-c0b2-431e-8869-3c82e9b05976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a530c4b9-1ff3-4364-acb6-0b2dde2324b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:09 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 1073741824 Jul 28 16:44:09 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:09 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Volume volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 (3aa61fbb-ea75-4cec-8aae-d0737bfbad70): created successfully Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a530c4b9-1ff3-4364-acb6-0b2dde2324b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Flow 'volume_create_manager' (1319841c-789c-4059-a8a9-f997aef4ea21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ad4140d6-826f-4fb1-aa88-0c35b985c0bb tempest-ProjectReaderTests-1761734348 None] Created volume successfully. Jul 28 16:44:09 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 1073741824" returned: 0 in 0.587s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:09 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 Jul 28 16:44:09 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-3aa61fbb-ea75-4cec-8aae-d0737bfbad70-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:10 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291" returned: 0 in 0.333s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Lock "cinder-3aa61fbb-ea75-4cec-8aae-d0737bfbad70-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c30f589-7dfa-44c0-a95c-6fcd2f4763b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3268c7-e839-435d-9487-1d659f102291', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de31c4bc-e753-433c-b2d3-dc84ddaf80d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Volume volume-6d3268c7-e839-435d-9487-1d659f102291 (6d3268c7-e839-435d-9487-1d659f102291): created successfully Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de31c4bc-e753-433c-b2d3-dc84ddaf80d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (56ddbce7-3e47-4836-bbf0-993ade26d48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-f29a4f17-d83e-4533-8e85-62c541d56e37 tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Acquiring lock "cinder-quobyte-3aa61fbb-ea75-4cec-8aae-d0737bfbad70" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-3aa61fbb-ea75-4cec-8aae-d0737bfbad70" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[c741b29e-0c25-491d-a733-cf058b0bf0df]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:10 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 Jul 28 16:44:10 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:10 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70" returned: 0 in 0.447s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:10 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70 Jul 28 16:44:10 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot 729dd867-f251-434a-84c5-95dc80bf41e7 of volume 6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7f9c7e-0763-427f-a5db-bdaac1a872ca]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:10 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3aa61fbb-ea75-4cec-8aae-d0737bfbad70" returned: 0 in 0.351s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Lock "cinder-quobyte-3aa61fbb-ea75-4cec-8aae-d0737bfbad70" released by "delete_volume" :: held 0.860s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:11 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 Jul 28 16:44:11 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Created reservations ['45fd5d2e-b4c3-4bfc-a4a4-75b65ababf92', '225679d3-f4f3-46fa-80f2-570779cf8fe5', '00589aa3-4fa4-4065-ab6c-5f80bacd9de2', '67658329-2b70-47ac-b937-61a5580c2a7f'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:11 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:11 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:11 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291" returned: 0 in 0.492s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:11 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 1G Jul 28 16:44:11 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:11 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.344s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:11 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Deleted volume successfully. Jul 28 16:44:11 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2834fd46-9d28-4fa6-b36c-b52da3c753cc tempest-ProjectReaderTests-1761734348 None] Lock "cinder-3aa61fbb-ea75-4cec-8aae-d0737bfbad70-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:12 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 1G" returned: 0 in 0.602s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3268c7-e839-435d-9487-1d659f102291 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:12 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3268c7-e839-435d-9487-1d659f102291 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 Jul 28 16:44:12 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:12 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3268c7-e839-435d-9487-1d659f102291 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7" returned: 0 in 0.356s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:12 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 is being set with open permissions: ugo+rw Jul 28 16:44:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:12 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 Jul 28 16:44:12 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:12 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7" returned: 0 in 0.322s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:12 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.info Jul 28 16:44:12 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:13 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.info" returned: 0 in 0.287s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:13 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.info is being set with open permissions: ugo+rw Jul 28 16:44:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:13 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.info Jul 28 16:44:13 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:13 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.info" returned: 0 in 0.304s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:13 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e22b34f3-1688-46f4-92c6-0271c86bc294 tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-729dd867-f251-434a-84c5-95dc80bf41e7-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-729dd867-f251-434a-84c5-95dc80bf41e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-6d3268c7-e839-435d-9487-1d659f102291" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-6d3268c7-e839-435d-9487-1d659f102291" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-729dd867-f251-434a-84c5-95dc80bf41e7" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-729dd867-f251-434a-84c5-95dc80bf41e7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot 729dd867-f251-434a-84c5-95dc80bf41e7 of volume 6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ebf3d0-c277-4869-adfc-03dbd66a7792]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:14 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 Jul 28 16:44:14 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:14 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7" returned: 0 in 0.447s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d3268c7-e839-435d-9487-1d659f102291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce7ef6-1730-4449-8a26-a16868a473d4]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:14 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 Jul 28 16:44:14 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:15 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291" returned: 0 in 0.390s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:15 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 Jul 28 16:44:15 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:15 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7" returned: 0 in 0.430s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:15 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7 Jul 28 16:44:15 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:15 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291.729dd867-f251-434a-84c5-95dc80bf41e7" returned: 0 in 0.347s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-729dd867-f251-434a-84c5-95dc80bf41e7" released by "_delete_snapshot" :: held 1.773s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-6d3268c7-e839-435d-9487-1d659f102291" released by "delete_snapshot" :: held 1.805s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Created reservations ['8dd54161-7902-4021-8f41-84ee7e769d75', '6323814c-2612-40b0-971b-3d6309fd28c3', 'ecc266d4-e8a2-4dc4-82f4-3d41ffa95449', 'a0e6b01a-2947-4daf-970b-32c73bae3c70'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:16 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-b06d2c7e-56e1-47b0-92b9-901e767f43b3 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-729dd867-f251-434a-84c5-95dc80bf41e7-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-6d3268c7-e839-435d-9487-1d659f102291-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-6d3268c7-e839-435d-9487-1d659f102291-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-6d3268c7-e839-435d-9487-1d659f102291" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-6d3268c7-e839-435d-9487-1d659f102291" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b2f5b-c443-4297-a78c-90944b73572e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:16 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 Jul 28 16:44:16 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:16 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:16 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291 Jul 28 16:44:16 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:17 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6d3268c7-e839-435d-9487-1d659f102291" returned: 0 in 0.290s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-6d3268c7-e839-435d-9487-1d659f102291" released by "delete_volume" :: held 0.837s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Created reservations ['6a253359-ce98-4097-a9e8-923e61f5f162', 'd34d24f8-49fc-4e0e-810f-3a46d8e90fe8', '4b923b3c-404f-455c-8468-86fc8f530c18', 'd6870ca3-b609-474c-94de-e80cab7c01be'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:17 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:17 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:17 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.339s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:44:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ed890121-8a59-4e19-b43c-6984ed5c5d99 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-6d3268c7-e839-435d-9487-1d659f102291-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (f402d936-d4cd-4907-a14c-95d467d45664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3e37ec-64a7-4f0e-831b-a746141777ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3e37ec-64a7-4f0e-831b-a746141777ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247713283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:18Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9736301-4e36-4828-ad40-87fa35c3ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9736301-4e36-4828-ad40-87fa35c3ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f30f9c0-bb29-47c6-93cc-3959ef835823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f30f9c0-bb29-47c6-93cc-3959ef835823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2', 'volume_name': 'volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f210fc19-fc5a-4da9-8b54-7b7e0495ab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f210fc19-fc5a-4da9-8b54-7b7e0495ab7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d86aaf-f66d-4571-baa8-c5038839ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:18 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Volume f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2', 'volume_size': 1} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247713283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:18Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Creating volume f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:44:18 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:18 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 1073741824 Jul 28 16:44:18 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:18 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 1073741824" returned: 0 in 0.483s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:18 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 Jul 28 16:44:18 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:19 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" returned: 0 in 0.259s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:44:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d86aaf-f66d-4571-baa8-c5038839ca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1321d2-bb8e-4964-a183-296727af660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:19 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Volume volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 (f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2): created successfully Jul 28 16:44:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1321d2-bb8e-4964-a183-296727af660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (f402d936-d4cd-4907-a14c-95d467d45664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:19 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d10b3bf3-90ee-47c8-a199-54cd89d188c4 tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:44:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot 14975a6a-ff9c-49c7-adec-44967dcbbbef of volume f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:44:20 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82a7dc-de6f-4959-aac4-a45abe89d205]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:20 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 Jul 28 16:44:20 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:20 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" returned: 0 in 0.399s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:20 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef 1G Jul 28 16:44:20 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:21 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef 1G" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:21 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef Jul 28 16:44:21 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:21 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef" returned: 0 in 0.332s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:21 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef is being set with open permissions: ugo+rw Jul 28 16:44:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:21 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef Jul 28 16:44:21 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:21 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef" returned: 0 in 0.265s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:22 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.info Jul 28 16:44:22 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:22 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.info" returned: 0 in 0.268s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:22 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.info is being set with open permissions: ugo+rw Jul 28 16:44:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:22 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.info Jul 28 16:44:22 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:22 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.info" returned: 0 in 0.273s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:22 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-39821f21-bd80-4027-b599-403f4a0a6ebf tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-14975a6a-ff9c-49c7-adec-44967dcbbbef-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Lock "cinder-14975a6a-ff9c-49c7-adec-44967dcbbbef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-14975a6a-ff9c-49c7-adec-44967dcbbbef" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-14975a6a-ff9c-49c7-adec-44967dcbbbef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot 14975a6a-ff9c-49c7-adec-44967dcbbbef of volume f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8e1a9e-f6e5-46e9-9d49-ae606f4fb6f2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:23 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef Jul 28 16:44:23 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:24 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef" returned: 0 in 0.438s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:44:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c81e17-24ae-4567-93ee-927ce34f4381]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:24 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 Jul 28 16:44:24 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:24 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" returned: 0 in 0.503s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:24 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:24 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef Jul 28 16:44:24 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:25 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef" returned: 0 in 0.414s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:25 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef Jul 28 16:44:25 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:25 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2.14975a6a-ff9c-49c7-adec-44967dcbbbef" returned: 0 in 0.293s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-14975a6a-ff9c-49c7-adec-44967dcbbbef" released by "_delete_snapshot" :: held 1.765s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" released by "delete_snapshot" :: held 1.792s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Created reservations ['94ed34fb-cdc5-4a00-8e1a-30663a18a94d', '911633be-cdd9-49ce-b280-3d62896e5d93', '34b1cd88-2724-4f5d-a6e1-eaae20c86bc5', '38f163ec-fd06-468b-b5ea-94cea4ca1fad'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:25 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-6445bb1b-6115-4b9c-bc10-5040b2512e0e tempest-ProjectMemberTests-1589750625 None] Lock "cinder-14975a6a-ff9c-49c7-adec-44967dcbbbef-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb17cd8-c0a4-4fec-8735-19436d77dfd8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:26 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 Jul 28 16:44:26 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:26 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" returned: 0 in 0.436s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:26 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2 Jul 28 16:44:26 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:26 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" returned: 0 in 0.303s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2" released by "delete_volume" :: held 0.806s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Created reservations ['9e97ca13-5835-44ac-be06-dad0efd5697b', '1fccf414-bae9-4177-946f-632b277aeaf2', '1c1de6e4-900c-4ef8-8347-4578605c99ab', '661899e4-6154-44a1-bf27-4464996ef1e8'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:26 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:26 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:27 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.283s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:27 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8866ce18-84c2-4951-b4b0-24ae62bfcd2f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-f6fbfcbc-5ee5-4fa1-9bf0-69f8eb1865b2-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (70bebdc4-dcda-401a-bbfb-ddb01af3a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ffff42-83b8-4685-9a3c-ffe733fdb654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ffff42-83b8-4685-9a3c-ffe733fdb654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137608959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3611a522-d84e-4a7b-9872-9d9396328f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:28Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc93c341-882f-412b-85b3-429b55fd1025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc93c341-882f-412b-85b3-429b55fd1025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7ce89-56bd-4fd6-86f7-82dd0c2c7c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7ce89-56bd-4fd6-86f7-82dd0c2c7c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3611a522-d84e-4a7b-9872-9d9396328f0b', 'volume_name': 'volume-3611a522-d84e-4a7b-9872-9d9396328f0b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476ff50c-54c8-40d9-89eb-96ebc60fa27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476ff50c-54c8-40d9-89eb-96ebc60fa27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182354bd-b759-452b-928d-382012fe647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:27 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Volume 3611a522-d84e-4a7b-9872-9d9396328f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3611a522-d84e-4a7b-9872-9d9396328f0b', 'volume_size': 1} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137608959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3611a522-d84e-4a7b-9872-9d9396328f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:28Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Creating volume 3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:44:27 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:44:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:27 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b 1073741824 Jul 28 16:44:27 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:28 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b 1073741824" returned: 0 in 0.480s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:28 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b Jul 28 16:44:28 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:28 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b" returned: 0 in 0.280s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182354bd-b759-452b-928d-382012fe647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3611a522-d84e-4a7b-9872-9d9396328f0b', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f7eca5-a6a3-4184-8b54-4cc600953da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:28 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Volume volume-3611a522-d84e-4a7b-9872-9d9396328f0b (3611a522-d84e-4a7b-9872-9d9396328f0b): created successfully Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f7eca5-a6a3-4184-8b54-4cc600953da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (70bebdc4-dcda-401a-bbfb-ddb01af3a24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2b135893-b750-470e-836f-978533b909d1 tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:44:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot 7f344e09-0bd9-46c3-9528-a7cd4e22ffda of volume 3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:44:29 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba557d-30e0-4667-a90f-26bd73108e1e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:30 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b Jul 28 16:44:30 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:30 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b" returned: 0 in 0.433s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:30 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda 1G Jul 28 16:44:30 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:30 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda 1G" returned: 0 in 0.467s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:30 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3611a522-d84e-4a7b-9872-9d9396328f0b -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:30 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3611a522-d84e-4a7b-9872-9d9396328f0b -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda Jul 28 16:44:30 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:31 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3611a522-d84e-4a7b-9872-9d9396328f0b -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda" returned: 0 in 0.346s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:31 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda is being set with open permissions: ugo+rw Jul 28 16:44:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:31 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda Jul 28 16:44:31 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:31 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda" returned: 0 in 0.275s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:31 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.info Jul 28 16:44:31 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:31 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.info" returned: 0 in 0.288s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:31 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.info is being set with open permissions: ugo+rw Jul 28 16:44:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:31 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.info Jul 28 16:44:31 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:32 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.info" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:32 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-6d344b74-db9c-44ec-83a2-bd32aca1d071 tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-7f344e09-0bd9-46c3-9528-a7cd4e22ffda-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-7f344e09-0bd9-46c3-9528-a7cd4e22ffda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-3611a522-d84e-4a7b-9872-9d9396328f0b" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-3611a522-d84e-4a7b-9872-9d9396328f0b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-7f344e09-0bd9-46c3-9528-a7cd4e22ffda" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-7f344e09-0bd9-46c3-9528-a7cd4e22ffda" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot 7f344e09-0bd9-46c3-9528-a7cd4e22ffda of volume 3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2425df-752f-4247-ba79-53317f0ccba1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:33 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda Jul 28 16:44:33 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:33 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda" returned: 0 in 0.404s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3611a522-d84e-4a7b-9872-9d9396328f0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0151384-b144-4fab-9dcf-577e611ce722]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:33 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b Jul 28 16:44:33 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:34 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b" returned: 0 in 0.392s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:34 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda Jul 28 16:44:34 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:34 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda" returned: 0 in 0.372s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:34 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda Jul 28 16:44:34 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:34 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b.7f344e09-0bd9-46c3-9528-a7cd4e22ffda" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-7f344e09-0bd9-46c3-9528-a7cd4e22ffda" released by "_delete_snapshot" :: held 1.589s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-3611a522-d84e-4a7b-9872-9d9396328f0b" released by "delete_snapshot" :: held 1.618s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Created reservations ['b61877e0-d8ec-498d-8bd9-0a858b04b439', '4c1251b1-ff32-46c6-83ca-eacb6862d2be', '831d3ba0-9cb8-435a-a194-128829be37ce', '2cdecadc-f413-455e-a640-8ba3180d0646'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:34 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:44:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cb7d8884-62a3-40a8-9f44-abe644b518b7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-7f344e09-0bd9-46c3-9528-a7cd4e22ffda-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-3611a522-d84e-4a7b-9872-9d9396328f0b-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-3611a522-d84e-4a7b-9872-9d9396328f0b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-3611a522-d84e-4a7b-9872-9d9396328f0b" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-3611a522-d84e-4a7b-9872-9d9396328f0b" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b7c260-97cd-490d-9144-5aa2a5de41fd]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:35 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b Jul 28 16:44:35 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:35 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b" returned: 0 in 0.417s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:35 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b Jul 28 16:44:35 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:36 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3611a522-d84e-4a7b-9872-9d9396328f0b" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-3611a522-d84e-4a7b-9872-9d9396328f0b" released by "delete_volume" :: held 0.758s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Created reservations ['eb082633-aa0c-4790-9348-67d095e04490', '9e1e88c7-126d-4017-81b5-f5b8299f59da', '1fe6f822-494a-47b8-b4de-8b297ba923a4', '05805602-2d4e-4365-b3f0-c4775e5b5bbf'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:36 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:36 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:36 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.299s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:36 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-7dd3358d-22bd-4e0e-b1f0-926b738340a7 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-3611a522-d84e-4a7b-9872-9d9396328f0b-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=217,cinder:SELECT=159,cinder:INSERT=62,cinder:DELETE=18 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (8db0ae33-03ae-4c97-9fa5-60966dab7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f3bfd4-0c8e-4e62-b3bc-b7d0abee8b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f3bfd4-0c8e-4e62-b3bc-b7d0abee8b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908951376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dd1c70-bf7c-47ad-a50d-10274ceab541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:37Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf967a7-981a-40b7-a1b9-04930584c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf967a7-981a-40b7-a1b9-04930584c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ec886e-ab8d-4e36-9197-a1630a629307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ec886e-ab8d-4e36-9197-a1630a629307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43dd1c70-bf7c-47ad-a50d-10274ceab541', 'volume_name': 'volume-43dd1c70-bf7c-47ad-a50d-10274ceab541', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364b8747-99de-4a78-96c4-db707c8bcc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364b8747-99de-4a78-96c4-db707c8bcc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbb1e62-1506-47cf-8342-a617e57b2233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:37 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Volume 43dd1c70-bf7c-47ad-a50d-10274ceab541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43dd1c70-bf7c-47ad-a50d-10274ceab541', 'volume_size': 1} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908951376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dd1c70-bf7c-47ad-a50d-10274ceab541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:37Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Creating volume 43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:44:37 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:37 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 1073741824 Jul 28 16:44:37 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:37 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 1073741824" returned: 0 in 0.492s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:37 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 Jul 28 16:44:37 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:37 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541" returned: 0 in 0.269s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbb1e62-1506-47cf-8342-a617e57b2233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43dd1c70-bf7c-47ad-a50d-10274ceab541', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4af7cb-8730-4d49-8350-eee3b3453e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:37 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Volume volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 (43dd1c70-bf7c-47ad-a50d-10274ceab541): created successfully Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4af7cb-8730-4d49-8350-eee3b3453e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (8db0ae33-03ae-4c97-9fa5-60966dab7423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:37 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=210,cinder:SELECT=159,cinder:INSERT=56,cinder:DELETE=18 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:44:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3b66648f-d1de-469e-837a-203e00566c87 tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:44:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot 93c7cd22-e34f-4324-bfb6-3813fb2e57c3 of volume 43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:44:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[5373f339-cdd3-4f12-be30-63415cdf4ee8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:39 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 Jul 28 16:44:39 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:39 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541" returned: 0 in 0.401s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:39 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 1G Jul 28 16:44:39 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:40 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 1G" returned: 0 in 0.445s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:40 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 Jul 28 16:44:40 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:40 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3" returned: 0 in 0.330s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:40 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 is being set with open permissions: ugo+rw Jul 28 16:44:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:40 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 Jul 28 16:44:40 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:40 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:40 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.info Jul 28 16:44:40 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:41 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.info" returned: 0 in 0.301s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:41 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.info is being set with open permissions: ugo+rw Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:41 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.info Jul 28 16:44:41 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:41 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:41 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:41 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.info" returned: 0 in 0.283s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:41 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.294s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:44:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:44:41 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-50c69e33-3816-4cd4-b23d-128cb5c5e665 tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-93c7cd22-e34f-4324-bfb6-3813fb2e57c3-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-93c7cd22-e34f-4324-bfb6-3813fb2e57c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-43dd1c70-bf7c-47ad-a50d-10274ceab541" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-43dd1c70-bf7c-47ad-a50d-10274ceab541" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-93c7cd22-e34f-4324-bfb6-3813fb2e57c3" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-93c7cd22-e34f-4324-bfb6-3813fb2e57c3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot 93c7cd22-e34f-4324-bfb6-3813fb2e57c3 of volume 43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cb07b6-d37d-4ad5-849a-c7da7db2abb5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:42 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 Jul 28 16:44:42 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:43 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3" returned: 0 in 0.420s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43dd1c70-bf7c-47ad-a50d-10274ceab541(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d87fe5-e6f2-472a-a464-00423653be72]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:43 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 Jul 28 16:44:43 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:43 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541" returned: 0 in 0.415s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:43 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 Jul 28 16:44:43 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:43 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3" returned: 0 in 0.376s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:43 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3 Jul 28 16:44:43 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:44 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541.93c7cd22-e34f-4324-bfb6-3813fb2e57c3" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-93c7cd22-e34f-4324-bfb6-3813fb2e57c3" released by "_delete_snapshot" :: held 1.626s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-43dd1c70-bf7c-47ad-a50d-10274ceab541" released by "delete_snapshot" :: held 1.653s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Created reservations ['c9b88de0-8b50-4161-b6a6-3a008dd79a3d', '12dbd8c5-2813-4ac7-98cb-f4464668de15', '556a9e01-43b8-438b-a5c9-ad29919c5482', '06565aa8-a854-414b-8aa7-4dcf93613e45'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-e0185571-e1fe-40f5-b5fa-f3fdc3814423 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-93c7cd22-e34f-4324-bfb6-3813fb2e57c3-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-43dd1c70-bf7c-47ad-a50d-10274ceab541-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-43dd1c70-bf7c-47ad-a50d-10274ceab541-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-43dd1c70-bf7c-47ad-a50d-10274ceab541" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-43dd1c70-bf7c-47ad-a50d-10274ceab541" acquired by "delete_volume" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8782ba-4c36-41d4-bd7c-5760342ba9be]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:44 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 Jul 28 16:44:44 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:45 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541" returned: 0 in 0.421s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:45 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541 Jul 28 16:44:45 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:45 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-43dd1c70-bf7c-47ad-a50d-10274ceab541" returned: 0 in 0.261s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-43dd1c70-bf7c-47ad-a50d-10274ceab541" released by "delete_volume" :: held 0.758s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Created reservations ['2ab23911-79fa-4641-b7d1-1fec70d9a1f7', '1aec7d8b-6f12-4553-89e1-191d5625e87b', '48c2bb3a-e003-48dd-8f3f-617569068684', 'a9f7d0b9-e750-4b54-ab95-3293e63ea875'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:45 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:45 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:45 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.277s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:45 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:45 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-07f2c096-11bd-4e7a-ba8b-dff9a1f3bac9 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-43dd1c70-bf7c-47ad-a50d-10274ceab541-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (8b78d309-78b5-41da-9daa-81a679fc0574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2c3b89-90c8-448d-999d-bc6446131cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2c3b89-90c8-448d-999d-bc6446131cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-477423030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4647a898-241a-4c79-bcf0-7e4df347de9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:46Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0eb7df0-938c-421d-9ad5-02758e9aafc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0eb7df0-938c-421d-9ad5-02758e9aafc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3d2ff5-68ab-417c-994e-1d0e5d6142a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3d2ff5-68ab-417c-994e-1d0e5d6142a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4647a898-241a-4c79-bcf0-7e4df347de9e', 'volume_name': 'volume-4647a898-241a-4c79-bcf0-7e4df347de9e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e0e0b0-ae9d-40f8-bab4-65473f2922ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e0e0b0-ae9d-40f8-bab4-65473f2922ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57276b92-c928-41fa-ba08-224869a69886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:46 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Volume 4647a898-241a-4c79-bcf0-7e4df347de9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4647a898-241a-4c79-bcf0-7e4df347de9e', 'volume_size': 1} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-477423030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4647a898-241a-4c79-bcf0-7e4df347de9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1471c0a2e8f4b2a8a4e4966b229acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:44:46Z,use_quota=True,user_id='0bcbcba377604b29b667a2a6e743802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Creating volume 4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:44:46 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:46 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e 1073741824 Jul 28 16:44:46 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:46 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e 1073741824" returned: 0 in 0.461s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:47 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e Jul 28 16:44:47 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:47 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:47 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:44:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57276b92-c928-41fa-ba08-224869a69886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4647a898-241a-4c79-bcf0-7e4df347de9e', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051ea5ae-bece-4bf7-8799-8d2c3ae7fa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:44:47 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Volume volume-4647a898-241a-4c79-bcf0-7e4df347de9e (4647a898-241a-4c79-bcf0-7e4df347de9e): created successfully Jul 28 16:44:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051ea5ae-bece-4bf7-8799-8d2c3ae7fa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:44:47 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Flow 'volume_create_manager' (8b78d309-78b5-41da-9daa-81a679fc0574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:44:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c22bf681-9402-4220-9b48-202cf49c61ca tempest-ProjectMemberTests-1589750625 None] Created volume successfully. Jul 28 16:44:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:48 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Creating offline snapshot 63707bd2-d7e7-4037-95a5-93397ac6659d of volume 4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:44:48 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b770d79-e49e-4e08-af4d-800e8879b0cb]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:48 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:48 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e Jul 28 16:44:48 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:49 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e" returned: 0 in 0.393s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:49 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d 1G Jul 28 16:44:49 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:49 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d 1G" returned: 0 in 0.436s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4647a898-241a-4c79-bcf0-7e4df347de9e -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:49 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4647a898-241a-4c79-bcf0-7e4df347de9e -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d Jul 28 16:44:49 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:49 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4647a898-241a-4c79-bcf0-7e4df347de9e -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d" returned: 0 in 0.297s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:49 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d is being set with open permissions: ugo+rw Jul 28 16:44:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:49 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d Jul 28 16:44:49 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:50 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d" returned: 0 in 0.330s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:50 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.info Jul 28 16:44:50 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:50 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.info" returned: 0 in 0.280s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:50 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.info is being set with open permissions: ugo+rw Jul 28 16:44:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:50 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.info Jul 28 16:44:50 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:50 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.info" returned: 0 in 0.324s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:50 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-0a5c594d-8f21-4584-a391-a9fec2a9da15 tempest-ProjectMemberTests-1589750625 None] Create snapshot completed successfully Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-63707bd2-d7e7-4037-95a5-93397ac6659d-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-63707bd2-d7e7-4037-95a5-93397ac6659d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-4647a898-241a-4c79-bcf0-7e4df347de9e" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-4647a898-241a-4c79-bcf0-7e4df347de9e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-63707bd2-d7e7-4037-95a5-93397ac6659d" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-63707bd2-d7e7-4037-95a5-93397ac6659d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Deleting offline snapshot 63707bd2-d7e7-4037-95a5-93397ac6659d of volume 4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] snapshot_file for this snap is: volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ab09d4-c35a-466b-a712-f52b61df17e7]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:52 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d Jul 28 16:44:52 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:52 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d" returned: 0 in 0.393s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4647a898-241a-4c79-bcf0-7e4df347de9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e0c180-550b-49cf-965d-7e3a9d67df15]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:52 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e Jul 28 16:44:52 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:52 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e" returned: 0 in 0.392s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:52 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:53 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d Jul 28 16:44:53 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:53 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d" returned: 0 in 0.363s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:53 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d Jul 28 16:44:53 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:53 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:53 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e.63707bd2-d7e7-4037-95a5-93397ac6659d" returned: 0 in 0.275s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-63707bd2-d7e7-4037-95a5-93397ac6659d" released by "_delete_snapshot" :: held 1.531s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-4647a898-241a-4c79-bcf0-7e4df347de9e" released by "delete_snapshot" :: held 1.561s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:53 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Created reservations ['169f1c72-6089-4991-9259-c6665bfdfc65', '077a04c7-37a1-46ad-bdb1-fe5e577c414c', 'c6ec701a-a41b-4ead-97e7-a2bdc64a3237', '966792de-eb99-4f11-a4df-bd0dcc54fee4'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:53 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Delete snapshot completed successfully. Jul 28 16:44:53 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-32b0ec9e-569b-4849-9d31-b07151eb7df2 tempest-ProjectMemberTests-1589750625 None] Lock "cinder-63707bd2-d7e7-4037-95a5-93397ac6659d-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-4647a898-241a-4c79-bcf0-7e4df347de9e-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-4647a898-241a-4c79-bcf0-7e4df347de9e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Acquiring lock "cinder-quobyte-4647a898-241a-4c79-bcf0-7e4df347de9e" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-4647a898-241a-4c79-bcf0-7e4df347de9e" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da8c4d2-3c54-4b12-86ce-d158569cbc88]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:54 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e Jul 28 16:44:54 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:54 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e" returned: 0 in 0.393s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:54 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e Jul 28 16:44:54 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:55 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4647a898-241a-4c79-bcf0-7e4df347de9e" returned: 0 in 0.288s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-quobyte-4647a898-241a-4c79-bcf0-7e4df347de9e" released by "delete_volume" :: held 0.749s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Created reservations ['1e474c8f-d9be-4818-8453-846c6d6c10b5', 'ce8aba3d-f18c-42d2-acb5-33d3fb301078', 'bc6859f1-b429-45d6-866f-5abb55e7da38', '1411dcbf-9ca5-410b-a34a-631395ac6a6e'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:44:55 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:44:55 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:44:55 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.308s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:44:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Deleted volume successfully. Jul 28 16:44:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-200ca002-ea4d-4d99-8b95-8a05d3d5e25f tempest-ProjectMemberTests-1589750625 None] Lock "cinder-4647a898-241a-4c79-bcf0-7e4df347de9e-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (2ef07cda-e9c6-4ab1-99c9-e8576921c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689ea6ec-7e2f-4bf8-82f2-a6e7dcf00c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689ea6ec-7e2f-4bf8-82f2-a6e7dcf00c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651614386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf29496-dfe2-4e76-9c18-ae330e83d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:00Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cef4d4-0b35-4e76-a3cc-320df43638a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cef4d4-0b35-4e76-a3cc-320df43638a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceaf18aa-e0e7-476a-a3c7-3702073f9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceaf18aa-e0e7-476a-a3c7-3702073f9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf29496-dfe2-4e76-9c18-ae330e83d137', 'volume_name': 'volume-4bf29496-dfe2-4e76-9c18-ae330e83d137', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52d08b8-1c6a-4db1-b7c4-eccf1ce470c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52d08b8-1c6a-4db1-b7c4-eccf1ce470c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60c4a44-b64b-48f3-ad38-d69ea1ef6d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:00 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Volume 4bf29496-dfe2-4e76-9c18-ae330e83d137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf29496-dfe2-4e76-9c18-ae330e83d137', 'volume_size': 1} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651614386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf29496-dfe2-4e76-9c18-ae330e83d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:00Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Creating volume 4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:45:00 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:00 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 1073741824 Jul 28 16:45:00 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:00 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 1073741824" returned: 0 in 0.474s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:01 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 Jul 28 16:45:01 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:01 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137" returned: 0 in 0.295s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:01 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:45:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60c4a44-b64b-48f3-ad38-d69ea1ef6d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf29496-dfe2-4e76-9c18-ae330e83d137', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119a69b4-6115-4f2a-b521-4d8c93f6e52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:01 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Volume volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 (4bf29496-dfe2-4e76-9c18-ae330e83d137): created successfully Jul 28 16:45:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119a69b4-6115-4f2a-b521-4d8c93f6e52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:01 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (2ef07cda-e9c6-4ab1-99c9-e8576921c400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-34f875af-5adc-4290-91b4-621950b0da7f tempest-ProjectReaderTests-736701739 None] Created volume successfully. Jul 28 16:45:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:02 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Creating offline snapshot 379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab of volume 4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:45:02 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae5c2a-5a55-4490-8c49-39d53e9d6407]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:02 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:02 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 Jul 28 16:45:02 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:03 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137" returned: 0 in 0.423s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:03 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab 1G Jul 28 16:45:03 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:03 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab 1G" returned: 0 in 0.544s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:03 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:03 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab Jul 28 16:45:03 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:04 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" returned: 0 in 0.360s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:04 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab is being set with open permissions: ugo+rw Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:04 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab Jul 28 16:45:04 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:04 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" returned: 0 in 0.293s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:04 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.info Jul 28 16:45:04 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:04 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.info" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:04 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.info is being set with open permissions: ugo+rw Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:04 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.info Jul 28 16:45:04 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:04 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.info" returned: 0 in 0.259s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:04 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:04 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-db567864-e569-420d-b7a0-79cceaf8f04b tempest-ProjectReaderTests-736701739 None] Create snapshot completed successfully Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Lock "cinder-379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-4bf29496-dfe2-4e76-9c18-ae330e83d137" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-4bf29496-dfe2-4e76-9c18-ae330e83d137" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Deleting offline snapshot 379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab of volume 4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] snapshot_file for this snap is: volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7266864-6e9e-4a8e-8f81-3ee533b49b8c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:06 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab Jul 28 16:45:06 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:06 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" returned: 0 in 0.397s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bf29496-dfe2-4e76-9c18-ae330e83d137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[314be835-3f8a-4fe5-a544-06a51ef1704a]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:06 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 Jul 28 16:45:06 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:06 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137" returned: 0 in 0.380s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:06 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:06 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab Jul 28 16:45:06 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:07 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" returned: 0 in 0.394s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:07 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab Jul 28 16:45:07 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:07 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:07 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137.379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab" released by "_delete_snapshot" :: held 1.559s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-4bf29496-dfe2-4e76-9c18-ae330e83d137" released by "delete_snapshot" :: held 1.584s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:07 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Created reservations ['2ad866b9-2953-4188-a051-fe68f7494b96', '91386ce2-277f-4603-bcba-851c26331a23', '4b9d3b89-1c7c-46af-bcf8-aaf3d2dee8de', '8f97c112-6a18-4240-9807-7ad04e3759d2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:07 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Delete snapshot completed successfully. Jul 28 16:45:07 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fcde62a8-8c1e-4d64-96f8-7886a0fa3c1d tempest-ProjectReaderTests-736701739 None] Lock "cinder-379c75ef-7c97-4daa-b3eb-f8aa4db2f9ab-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-4bf29496-dfe2-4e76-9c18-ae330e83d137-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Lock "cinder-4bf29496-dfe2-4e76-9c18-ae330e83d137-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-4bf29496-dfe2-4e76-9c18-ae330e83d137" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-4bf29496-dfe2-4e76-9c18-ae330e83d137" acquired by "delete_volume" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[db042604-be10-4e61-be4c-63188a80bded]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:08 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 Jul 28 16:45:08 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:08 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137" returned: 0 in 0.384s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:08 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:08 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137 Jul 28 16:45:08 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:09 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-4bf29496-dfe2-4e76-9c18-ae330e83d137" returned: 0 in 0.277s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-4bf29496-dfe2-4e76-9c18-ae330e83d137" released by "delete_volume" :: held 0.726s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Created reservations ['5c7ee1cd-cb88-4470-ad8f-35e63130afc2', '3b5b6816-0277-45d4-b813-8537d346b506', 'a19bdc6b-70cb-4ba8-b3c6-5ffdc93f8fa1', '0dda03e2-e5a3-415e-a99a-f33babf805b9'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:09 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:45:09 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:09 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.307s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:45:09 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Deleted volume successfully. Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-2a9bcd7f-81be-45cf-a415-4b327bd408f5 tempest-ProjectReaderTests-736701739 None] Lock "cinder-4bf29496-dfe2-4e76-9c18-ae330e83d137-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:45:09 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (194ba331-9d42-4ae4-b37d-116857a2f729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4394617e-3b6d-4180-8ad2-ef6ca16b9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4394617e-3b6d-4180-8ad2-ef6ca16b9f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187476742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f37e4e6-73e9-4847-84ac-656e19f60021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:10Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34345ddc-fc55-4c95-a76b-c62c54f048cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34345ddc-fc55-4c95-a76b-c62c54f048cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0330bfb-0cc7-4482-898f-a341808ba501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0330bfb-0cc7-4482-898f-a341808ba501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f37e4e6-73e9-4847-84ac-656e19f60021', 'volume_name': 'volume-3f37e4e6-73e9-4847-84ac-656e19f60021', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bd75a5-13ce-44bb-b2b3-736760c996c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bd75a5-13ce-44bb-b2b3-736760c996c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279b63c-a683-4c2e-a404-f173d267eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Volume 3f37e4e6-73e9-4847-84ac-656e19f60021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f37e4e6-73e9-4847-84ac-656e19f60021', 'volume_size': 1} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187476742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f37e4e6-73e9-4847-84ac-656e19f60021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:10Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Creating volume 3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:45:10 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:10 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 1073741824 Jul 28 16:45:10 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:10 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 1073741824" returned: 0 in 0.477s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:10 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 Jul 28 16:45:10 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:10 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021" returned: 0 in 0.291s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279b63c-a683-4c2e-a404-f173d267eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f37e4e6-73e9-4847-84ac-656e19f60021', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a3a5f1-a262-4e55-92f8-618ad59e4597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:10 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Volume volume-3f37e4e6-73e9-4847-84ac-656e19f60021 (3f37e4e6-73e9-4847-84ac-656e19f60021): created successfully Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a3a5f1-a262-4e55-92f8-618ad59e4597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:10 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (194ba331-9d42-4ae4-b37d-116857a2f729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:10 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-290c1312-e7b3-4920-a0d8-17e345f5e157 tempest-ProjectReaderTests-736701739 None] Created volume successfully. Jul 28 16:45:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:12 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Creating offline snapshot e186e671-ed8d-410c-b93c-584e00948d27 of volume 3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:45:12 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[b787f48d-2e22-49dc-a723-6cc7b8e78088]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:12 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 Jul 28 16:45:12 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:12 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:12 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:12 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 1G Jul 28 16:45:12 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:13 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 1G" returned: 0 in 0.493s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f37e4e6-73e9-4847-84ac-656e19f60021 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:13 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f37e4e6-73e9-4847-84ac-656e19f60021 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 Jul 28 16:45:13 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:13 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f37e4e6-73e9-4847-84ac-656e19f60021 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27" returned: 0 in 0.334s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:13 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 is being set with open permissions: ugo+rw Jul 28 16:45:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:13 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 Jul 28 16:45:13 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:13 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:13 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:13 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.info Jul 28 16:45:13 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:14 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.info" returned: 0 in 0.303s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:14 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.info is being set with open permissions: ugo+rw Jul 28 16:45:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:14 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.info Jul 28 16:45:14 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:14 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.info" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:14 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:14 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-99959f52-b256-42ac-9800-2282b16941b2 tempest-ProjectReaderTests-736701739 None] Create snapshot completed successfully Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-e186e671-ed8d-410c-b93c-584e00948d27-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Lock "cinder-e186e671-ed8d-410c-b93c-584e00948d27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-3f37e4e6-73e9-4847-84ac-656e19f60021" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-3f37e4e6-73e9-4847-84ac-656e19f60021" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-e186e671-ed8d-410c-b93c-584e00948d27" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-e186e671-ed8d-410c-b93c-584e00948d27" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Deleting offline snapshot e186e671-ed8d-410c-b93c-584e00948d27 of volume 3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] snapshot_file for this snap is: volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7886c2c2-b14b-422f-ba22-56dae41a5848]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:15 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 Jul 28 16:45:15 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:15 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27" returned: 0 in 0.396s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:15 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f37e4e6-73e9-4847-84ac-656e19f60021(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:45:16 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1ff89-9f04-42dc-b63b-44249728f687]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:16 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 Jul 28 16:45:16 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:16 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021" returned: 0 in 0.428s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:16 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 Jul 28 16:45:16 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:16 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27" returned: 0 in 0.382s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:16 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:16 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27 Jul 28 16:45:16 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:17 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021.e186e671-ed8d-410c-b93c-584e00948d27" returned: 0 in 0.281s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-e186e671-ed8d-410c-b93c-584e00948d27" released by "_delete_snapshot" :: held 1.597s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-3f37e4e6-73e9-4847-84ac-656e19f60021" released by "delete_snapshot" :: held 1.624s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Created reservations ['f7cbb81e-eb64-42c2-93da-45d270870c22', '22baa083-28cd-4255-96cf-b64e0bf6f9fb', '8d47b576-248f-4c8e-a764-42ba0063581c', 'a339c7e9-c7ef-47d6-81cf-8057b1a7c3b2'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:17 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Delete snapshot completed successfully. Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3cc95f88-9195-4f67-a0e8-e94980ad7fbd tempest-ProjectReaderTests-736701739 None] Lock "cinder-e186e671-ed8d-410c-b93c-584e00948d27-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-3f37e4e6-73e9-4847-84ac-656e19f60021-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Lock "cinder-3f37e4e6-73e9-4847-84ac-656e19f60021-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-3f37e4e6-73e9-4847-84ac-656e19f60021" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-3f37e4e6-73e9-4847-84ac-656e19f60021" acquired by "delete_volume" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca8467b-0545-40af-9381-2911ddfb66b1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:17 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:17 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 Jul 28 16:45:17 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:18 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021" returned: 0 in 0.409s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:18 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021 Jul 28 16:45:18 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:18 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3f37e4e6-73e9-4847-84ac-656e19f60021" returned: 0 in 0.293s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-3f37e4e6-73e9-4847-84ac-656e19f60021" released by "delete_volume" :: held 0.779s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Created reservations ['feca99f0-0b09-410f-bf3f-5c745ded9dce', '298debdf-4cf7-4af9-ac97-5cf8bda1e55b', '10656814-0b86-4d6a-a53f-704a7bb907da', '6924cc92-052b-4176-945d-3405195f6007'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:18 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:18 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:45:18 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:19 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.335s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:45:19 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Deleted volume successfully. Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-3b8f3940-db51-4332-9f2e-6875db9b1501 tempest-ProjectReaderTests-736701739 None] Lock "cinder-3f37e4e6-73e9-4847-84ac-656e19f60021-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (e5d9717a-d1ec-4a4f-8ef9-6b9c572f3613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747e573e-ecf8-4423-b52c-1ab65f2cc048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747e573e-ecf8-4423-b52c-1ab65f2cc048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469398281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6940529f-0dcd-4ec9-8d57-36882b53d6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:19Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20056ead-3213-4c22-8707-98262980892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20056ead-3213-4c22-8707-98262980892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76890515-5f61-4246-baaa-9cccea657df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76890515-5f61-4246-baaa-9cccea657df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6940529f-0dcd-4ec9-8d57-36882b53d6f4', 'volume_name': 'volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c7f968-00ea-4425-814b-6ce4ca9926ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c7f968-00ea-4425-814b-6ce4ca9926ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afa8402-3389-488f-a14b-b4fac2456e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:19 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Volume 6940529f-0dcd-4ec9-8d57-36882b53d6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4', 'volume_size': 1} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469398281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6940529f-0dcd-4ec9-8d57-36882b53d6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:19Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Creating volume 6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:45:19 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:45:19 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:19 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 1073741824 Jul 28 16:45:19 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:20 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 1073741824" returned: 0 in 0.510s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:20 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 Jul 28 16:45:20 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:20 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4" returned: 0 in 0.276s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afa8402-3389-488f-a14b-b4fac2456e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27e96ab-6dfe-420a-9582-314e46e98551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:20 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Volume volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 (6940529f-0dcd-4ec9-8d57-36882b53d6f4): created successfully Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27e96ab-6dfe-420a-9582-314e46e98551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:20 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (e5d9717a-d1ec-4a4f-8ef9-6b9c572f3613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:20 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-62ec0874-8f4a-4d2b-995d-dd5029e2261b tempest-ProjectReaderTests-736701739 None] Created volume successfully. Jul 28 16:45:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:21 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Creating offline snapshot 5848a6b6-8a57-4e76-a090-b32cf850e22f of volume 6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:45:21 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feebba4-0c79-4ff0-9800-f7ff3de5b299]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:21 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:21 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 Jul 28 16:45:21 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:22 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4" returned: 0 in 0.422s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:22 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f 1G Jul 28 16:45:22 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:22 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f 1G" returned: 0 in 0.466s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:22 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f Jul 28 16:45:22 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:22 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f" returned: 0 in 0.335s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:22 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f is being set with open permissions: ugo+rw Jul 28 16:45:22 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:22 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f Jul 28 16:45:22 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:23 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f" returned: 0 in 0.306s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:23 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.info Jul 28 16:45:23 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:23 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.info" returned: 0 in 0.315s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:23 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.info is being set with open permissions: ugo+rw Jul 28 16:45:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:23 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.info Jul 28 16:45:23 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:23 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.info" returned: 0 in 0.297s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:23 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:23 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d54e0779-e076-4aa3-bdd6-c47f57cf836a tempest-ProjectReaderTests-736701739 None] Create snapshot completed successfully Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-5848a6b6-8a57-4e76-a090-b32cf850e22f-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Lock "cinder-5848a6b6-8a57-4e76-a090-b32cf850e22f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-6940529f-0dcd-4ec9-8d57-36882b53d6f4" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-6940529f-0dcd-4ec9-8d57-36882b53d6f4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-5848a6b6-8a57-4e76-a090-b32cf850e22f" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-5848a6b6-8a57-4e76-a090-b32cf850e22f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Deleting offline snapshot 5848a6b6-8a57-4e76-a090-b32cf850e22f of volume 6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] snapshot_file for this snap is: volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:45:24 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19a0c0-a527-44dc-9d34-ede67fdefcd2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:25 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f Jul 28 16:45:25 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:25 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f" returned: 0 in 0.471s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:25 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:45:25 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d931e5-2812-4ad0-a3c1-169b06090cc0]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:25 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 Jul 28 16:45:25 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:25 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4" returned: 0 in 0.440s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:25 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:25 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f Jul 28 16:45:25 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:26 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f" returned: 0 in 0.383s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:26 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f Jul 28 16:45:26 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:26 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:26 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4.5848a6b6-8a57-4e76-a090-b32cf850e22f" returned: 0 in 0.280s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-5848a6b6-8a57-4e76-a090-b32cf850e22f" released by "_delete_snapshot" :: held 1.683s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-6940529f-0dcd-4ec9-8d57-36882b53d6f4" released by "delete_snapshot" :: held 1.711s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:26 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Created reservations ['7ba4468e-a0e3-4b43-9cac-03a630c9d82e', 'bc689a9b-7e0f-4657-9b92-cee8afb1d2fe', 'd98fe9d9-6359-411e-9b4b-646f583232f1', 'e05b7d1b-e5a5-43da-a40f-dbe0c2bebf4a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:26 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Delete snapshot completed successfully. Jul 28 16:45:26 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-cf248719-2d8e-4589-9573-16f4da64da0e tempest-ProjectReaderTests-736701739 None] Lock "cinder-5848a6b6-8a57-4e76-a090-b32cf850e22f-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-6940529f-0dcd-4ec9-8d57-36882b53d6f4-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Lock "cinder-6940529f-0dcd-4ec9-8d57-36882b53d6f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-6940529f-0dcd-4ec9-8d57-36882b53d6f4" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-6940529f-0dcd-4ec9-8d57-36882b53d6f4" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9688e361-a19f-4cf5-a9e7-47c7a51ba9e5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:27 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 Jul 28 16:45:27 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:27 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4" returned: 0 in 0.414s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:27 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4 Jul 28 16:45:27 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:27 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-6940529f-0dcd-4ec9-8d57-36882b53d6f4" returned: 0 in 0.293s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:27 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-6940529f-0dcd-4ec9-8d57-36882b53d6f4" released by "delete_volume" :: held 0.782s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Created reservations ['31e18a67-5b79-4224-8f44-7265fac52a6e', '0c71c06c-4744-4897-9fde-3a8d659e8009', 'eb62fb54-4f23-4bda-8a84-70ed2855fed8', 'ad8ab348-f0a1-43b0-bbe3-890ea42dbc47'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:28 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:45:28 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:28 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.272s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:45:28 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Deleted volume successfully. Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-fee85dea-6683-4b6c-ab7a-1a8620a1c20f tempest-ProjectReaderTests-736701739 None] Lock "cinder-6940529f-0dcd-4ec9-8d57-36882b53d6f4-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (47f31fde-c2fe-435c-b176-59a68602cf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac86af07-c97b-4052-bebd-8545153d1702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac86af07-c97b-4052-bebd-8545153d1702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620200651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ef4940-375b-4496-868b-419e958cc950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:29Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90b645b-7a7f-43b6-84ea-3acf9ddb6b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90b645b-7a7f-43b6-84ea-3acf9ddb6b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b3938f-d1ac-4eef-a4d4-dd12b6af77ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b3938f-d1ac-4eef-a4d4-dd12b6af77ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ef4940-375b-4496-868b-419e958cc950', 'volume_name': 'volume-a0ef4940-375b-4496-868b-419e958cc950', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302d248a-0fce-4023-89f7-db8e42b7f107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302d248a-0fce-4023-89f7-db8e42b7f107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581e2ae3-7ab1-46ef-96d2-f64a0dc4291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:28 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Volume a0ef4940-375b-4496-868b-419e958cc950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ef4940-375b-4496-868b-419e958cc950', 'volume_size': 1} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620200651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ef4940-375b-4496-868b-419e958cc950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:29Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Creating volume a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:45:28 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:45:28 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:28 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 1073741824 Jul 28 16:45:28 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:29 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 1073741824" returned: 0 in 0.486s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:29 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 Jul 28 16:45:29 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:29 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950" returned: 0 in 0.256s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581e2ae3-7ab1-46ef-96d2-f64a0dc4291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ef4940-375b-4496-868b-419e958cc950', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c34e0b-cd35-498e-9002-1b513a73b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:29 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Volume volume-a0ef4940-375b-4496-868b-419e958cc950 (a0ef4940-375b-4496-868b-419e958cc950): created successfully Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c34e0b-cd35-498e-9002-1b513a73b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:29 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (47f31fde-c2fe-435c-b176-59a68602cf9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:29 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-5dc484e9-9158-43f3-9bc2-8ecbb6bf7133 tempest-ProjectReaderTests-736701739 None] Created volume successfully. Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Creating offline snapshot 7c92837a-ff4d-41ae-8eaf-1838846227d7 of volume a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[14824aba-68a7-4760-b03d-e4710bffaf97]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:31 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 Jul 28 16:45:31 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:31 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950" returned: 0 in 0.408s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:31 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 1G Jul 28 16:45:31 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:31 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 1G" returned: 0 in 0.451s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:31 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ef4940-375b-4496-868b-419e958cc950 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:31 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ef4940-375b-4496-868b-419e958cc950 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 Jul 28 16:45:31 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:32 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ef4940-375b-4496-868b-419e958cc950 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7" returned: 0 in 0.328s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:32 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 is being set with open permissions: ugo+rw Jul 28 16:45:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:32 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 Jul 28 16:45:32 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:32 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7" returned: 0 in 0.262s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:32 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.info Jul 28 16:45:32 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:32 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.info" returned: 0 in 0.296s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:32 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.info is being set with open permissions: ugo+rw Jul 28 16:45:32 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:32 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.info Jul 28 16:45:32 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:33 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.info" returned: 0 in 0.267s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:33 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:33 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-4d85fb01-6076-4064-afc2-a2ed215de98c tempest-ProjectReaderTests-736701739 None] Create snapshot completed successfully Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-7c92837a-ff4d-41ae-8eaf-1838846227d7-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Lock "cinder-7c92837a-ff4d-41ae-8eaf-1838846227d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-a0ef4940-375b-4496-868b-419e958cc950" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-a0ef4940-375b-4496-868b-419e958cc950" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-7c92837a-ff4d-41ae-8eaf-1838846227d7" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-7c92837a-ff4d-41ae-8eaf-1838846227d7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Deleting offline snapshot 7c92837a-ff4d-41ae-8eaf-1838846227d7 of volume a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] snapshot_file for this snap is: volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a69c8e5-73b5-485e-903e-468a20b43b21]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:34 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 Jul 28 16:45:34 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:34 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7" returned: 0 in 0.375s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ef4940-375b-4496-868b-419e958cc950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[9872423f-1693-4612-8709-7792d67b3144]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:34 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:34 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 Jul 28 16:45:34 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:35 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950" returned: 0 in 0.384s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:35 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 Jul 28 16:45:35 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:35 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7" returned: 0 in 0.350s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:35 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7 Jul 28 16:45:35 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:35 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950.7c92837a-ff4d-41ae-8eaf-1838846227d7" returned: 0 in 0.247s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-7c92837a-ff4d-41ae-8eaf-1838846227d7" released by "_delete_snapshot" :: held 1.451s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-a0ef4940-375b-4496-868b-419e958cc950" released by "delete_snapshot" :: held 1.475s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Created reservations ['acc87e89-01cb-402d-8ed2-8db0d13e0301', '49564382-3d5f-4fdf-a28e-de2fb444e3e7', '0c1e1533-9d86-4b6e-b75f-4fe7c73b71cf', 'b571b6b8-7fa1-437c-98fe-205017b0ca08'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:35 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Delete snapshot completed successfully. Jul 28 16:45:35 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-ce7865de-9d9a-420e-a1fb-66b7128a1a65 tempest-ProjectReaderTests-736701739 None] Lock "cinder-7c92837a-ff4d-41ae-8eaf-1838846227d7-delete_snapshot" released by "delete_snapshot" :: held 1.620s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-a0ef4940-375b-4496-868b-419e958cc950-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Lock "cinder-a0ef4940-375b-4496-868b-419e958cc950-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-a0ef4940-375b-4496-868b-419e958cc950" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-a0ef4940-375b-4496-868b-419e958cc950" acquired by "delete_volume" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f37c7b-8ce6-4931-862a-9eb00e659a11]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:36 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 Jul 28 16:45:36 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:36 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950" returned: 0 in 0.406s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:36 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:36 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950 Jul 28 16:45:36 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:37 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a0ef4940-375b-4496-868b-419e958cc950" returned: 0 in 0.289s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-a0ef4940-375b-4496-868b-419e958cc950" released by "delete_volume" :: held 0.775s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=85,cinder:UPDATE=99,cinder:DELETE=8,cinder:INSERT=28 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Created reservations ['aafcd8e6-1a10-48eb-9c57-ca6838079953', '68087514-3d13-4eb2-b792-2517f8fd69f0', '4f217174-d6d0-4fd7-aea9-82cc171dffd6', 'bd06ed82-5738-4ce0-be54-3bde2a69f943'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:37 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:45:37 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:37 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.302s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:45:37 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Deleted volume successfully. Jul 28 16:45:37 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-bfd0df18-7b06-4545-81a4-400ed9c25747 tempest-ProjectReaderTests-736701739 None] Lock "cinder-a0ef4940-375b-4496-868b-419e958cc950-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=107,cinder:SELECT=79,cinder:INSERT=30,cinder:DELETE=10 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (403a6d9b-abcb-4d8d-9a55-d120c0b91ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8312a94e-55de-45ed-b72d-d4d29fc4a96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8312a94e-55de-45ed-b72d-d4d29fc4a96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41718969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd69ad8d-9f14-4975-8810-fdc61b62590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:38Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f76bc8-31c8-4af8-bae6-11de596dd480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f76bc8-31c8-4af8-bae6-11de596dd480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead305b7-58b8-4c56-88e2-83d4f6c4307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead305b7-58b8-4c56-88e2-83d4f6c4307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd69ad8d-9f14-4975-8810-fdc61b62590c', 'volume_name': 'volume-fd69ad8d-9f14-4975-8810-fdc61b62590c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc109330-4379-4903-930d-b4870d6268c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc109330-4379-4903-930d-b4870d6268c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd7a68d-106f-4307-a344-cb43013bca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:38 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Volume fd69ad8d-9f14-4975-8810-fdc61b62590c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd69ad8d-9f14-4975-8810-fdc61b62590c', 'volume_size': 1} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41718969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd69ad8d-9f14-4975-8810-fdc61b62590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15e4b82371a49bd9d52699320114d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:45:38Z,use_quota=True,user_id='66fcceaa8eb4468ebfeab036d4802ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Creating volume fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:45:38 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:38 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c 1073741824 Jul 28 16:45:38 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:38 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c 1073741824" returned: 0 in 0.436s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:38 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c Jul 28 16:45:38 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:38 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c" returned: 0 in 0.257s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd7a68d-106f-4307-a344-cb43013bca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd69ad8d-9f14-4975-8810-fdc61b62590c', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:38 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b103776-810f-4173-9b53-31c90a5c3e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:45:39 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Volume volume-fd69ad8d-9f14-4975-8810-fdc61b62590c (fd69ad8d-9f14-4975-8810-fdc61b62590c): created successfully Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b103776-810f-4173-9b53-31c90a5c3e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Flow 'volume_create_manager' (403a6d9b-abcb-4d8d-9a55-d120c0b91ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:45:39 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-befdde9e-141f-4faa-b894-5e2a218cc6fb tempest-ProjectReaderTests-736701739 None] Created volume successfully. Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Creating offline snapshot e408c98a-f424-42a4-907e-9a8fbdba6bdd of volume fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c2a64-c8e6-4940-a881-638c1f526cd5]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:39 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c Jul 28 16:45:39 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:39 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c" returned: 0 in 0.411s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:39 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:39 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd 1G Jul 28 16:45:39 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:40 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd 1G" returned: 0 in 0.450s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd69ad8d-9f14-4975-8810-fdc61b62590c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:40 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd69ad8d-9f14-4975-8810-fdc61b62590c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd Jul 28 16:45:40 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:40 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd69ad8d-9f14-4975-8810-fdc61b62590c -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd" returned: 0 in 0.320s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:40 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd is being set with open permissions: ugo+rw Jul 28 16:45:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:40 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd Jul 28 16:45:40 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:40 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd" returned: 0 in 0.284s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:40 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:40 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.info Jul 28 16:45:40 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:41 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.info" returned: 0 in 0.292s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:41 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.info is being set with open permissions: ugo+rw Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:41 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:45:41 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:41 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.info Jul 28 16:45:41 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:41 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.275s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:45:41 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.info" returned: 0 in 0.315s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:41 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-33d29d39-94d7-4117-9126-dab754d55c24 tempest-ProjectReaderTests-736701739 None] Create snapshot completed successfully Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-e408c98a-f424-42a4-907e-9a8fbdba6bdd-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Lock "cinder-e408c98a-f424-42a4-907e-9a8fbdba6bdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-fd69ad8d-9f14-4975-8810-fdc61b62590c" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-fd69ad8d-9f14-4975-8810-fdc61b62590c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-e408c98a-f424-42a4-907e-9a8fbdba6bdd" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-e408c98a-f424-42a4-907e-9a8fbdba6bdd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Deleting offline snapshot e408c98a-f424-42a4-907e-9a8fbdba6bdd of volume fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] snapshot_file for this snap is: volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f155f2c-6395-467c-aab2-055684cf495c]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:42 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:42 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd Jul 28 16:45:42 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:43 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd" returned: 0 in 0.418s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd69ad8d-9f14-4975-8810-fdc61b62590c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4199d32a-6fb1-4d0a-b599-0d2e19472283]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:43 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c Jul 28 16:45:43 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:43 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c" returned: 0 in 0.403s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:43 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd Jul 28 16:45:43 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:43 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd" returned: 0 in 0.399s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:43 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd Jul 28 16:45:43 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:44 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c.e408c98a-f424-42a4-907e-9a8fbdba6bdd" returned: 0 in 0.251s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-e408c98a-f424-42a4-907e-9a8fbdba6bdd" released by "_delete_snapshot" :: held 1.578s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-fd69ad8d-9f14-4975-8810-fdc61b62590c" released by "delete_snapshot" :: held 1.603s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Created reservations ['664e4b79-e3c0-4c37-91ae-602e31247f57', '2cb86e2d-2ef4-4f01-80f9-95ab62d89aae', '5f2205b2-0802-4447-a6bf-864e31926bb0', '78c71568-2e6a-4d95-9de2-0063ad17709a'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Delete snapshot completed successfully. Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-96e8b486-4407-41d6-afd2-d63abf912121 tempest-ProjectReaderTests-736701739 None] Lock "cinder-e408c98a-f424-42a4-907e-9a8fbdba6bdd-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-fd69ad8d-9f14-4975-8810-fdc61b62590c-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Lock "cinder-fd69ad8d-9f14-4975-8810-fdc61b62590c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Acquiring lock "cinder-quobyte-fd69ad8d-9f14-4975-8810-fdc61b62590c" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-fd69ad8d-9f14-4975-8810-fdc61b62590c" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde5570-c576-4a68-978c-749f01fb4e73]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:45:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:44 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c Jul 28 16:45:44 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:45 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c" returned: 0 in 0.410s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:45 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c Jul 28 16:45:45 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:45 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-fd69ad8d-9f14-4975-8810-fdc61b62590c" returned: 0 in 0.333s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Lock "cinder-quobyte-fd69ad8d-9f14-4975-8810-fdc61b62590c" released by "delete_volume" :: held 0.815s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Created reservations ['aadffe0c-e6c0-485c-9347-ba9bf339adde', '72dd499c-6961-4019-b1f1-72e414a9dc3a', '10396879-c4b1-46f9-9cab-93eeb120e5a7', '37d0a982-440a-4aa7-a853-8ec61ce07938'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:45:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:45:45 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:45:45 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:45:46 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 28 16:45:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.301s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:45:46 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:45:46 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Deleted volume successfully. Jul 28 16:45:46 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-8d2116ed-09a2-45b8-b7bd-5ed4637592d2 tempest-ProjectReaderTests-736701739 None] Lock "cinder-fd69ad8d-9f14-4975-8810-fdc61b62590c-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:45:55 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:INSERT=6,cinder:UPDATE=13,cinder:SELECT=16,cinder:DELETE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:45:56 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:INSERT=5,cinder:UPDATE=30,cinder:SELECT=13,cinder:DELETE=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:46:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:46:36 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=1 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:41 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:46:41 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:41 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.282s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG oslo_service.periodic_task [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] Running periodic task VolumeManager._thread_info {{(pid=88286) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread count: 28 {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 16:46:41 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-6d8a0804-ef2d-49ab-94d4-4d3245ac5457 None None] thread info: [<_MainThread(MainThread, started 130626214621312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88286) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Flow 'volume_create_manager' (58efb8eb-990f-4ec8-8540-650cbab00127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9972e679-3328-43d9-9284-cdb2337e01b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9972e679-3328-43d9-9284-cdb2337e01b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1289920822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d99be6-2fea-42d4-9040-a382c2580e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d578afa65a454a0590c73b5ebf38c64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:46:43Z,use_quota=True,user_id='3c79bdc28dc848cf8a6409b8ff7db593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc20e03-4fbb-43c0-a96d-5cea67543de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc20e03-4fbb-43c0-a96d-5cea67543de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ae7735-d592-4692-a427-819b56d983e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ae7735-d592-4692-a427-819b56d983e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d99be6-2fea-42d4-9040-a382c2580e95', 'volume_name': 'volume-a8d99be6-2fea-42d4-9040-a382c2580e95', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f883fa-b7b2-406e-a02c-916d0334fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f883fa-b7b2-406e-a02c-916d0334fd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2684b-6140-4683-a4e2-313d71cf8f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:43 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Volume a8d99be6-2fea-42d4-9040-a382c2580e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d99be6-2fea-42d4-9040-a382c2580e95', 'volume_size': 1} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1289920822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d99be6-2fea-42d4-9040-a382c2580e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d578afa65a454a0590c73b5ebf38c64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:46:43Z,use_quota=True,user_id='3c79bdc28dc848cf8a6409b8ff7db593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)}" {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Creating volume a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:46:43 devstack cinder-volume[88286]: INFO cinder.volume.drivers.remotefs [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] casted to osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff Jul 28 16:46:43 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 1073741824 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:43 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 1073741824 Jul 28 16:46:43 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:44 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 1073741824" returned: 0 in 0.463s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:44 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 Jul 28 16:46:44 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:44 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95" returned: 0 in 0.295s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'} {{(pid=88286) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2684b-6140-4683-a4e2-313d71cf8f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d99be6-2fea-42d4-9040-a382c2580e95', 'volume_size': 1}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74eb751-7c6f-4648-bdcd-9a37716f9703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:44 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Volume volume-a8d99be6-2fea-42d4-9040-a382c2580e95 (a8d99be6-2fea-42d4-9040-a382c2580e95): created successfully Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74eb751-7c6f-4648-bdcd-9a37716f9703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:44 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Flow 'volume_create_manager' (58efb8eb-990f-4ec8-8540-650cbab00127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:46:44 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-e48a8edf-d2d9-424e-bab5-eea2d3b0ee18 tempest-SnapshotDependencyTests-1516399586 None] Created volume successfully. Jul 28 16:46:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:45 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Creating offline snapshot 5652af00-75b5-45d0-b91d-227762df3dc9 of volume a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 16:46:45 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f83653-a3c8-49a1-ba7a-27fe60b7c61d]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:45 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:46 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 Jul 28 16:46:46 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:46 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95" returned: 0 in 0.391s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 1G {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:46 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 1G Jul 28 16:46:46 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:46 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 1G" returned: 0 in 0.453s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:46 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d99be6-2fea-42d4-9040-a382c2580e95 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:46 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d99be6-2fea-42d4-9040-a382c2580e95 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 Jul 28 16:46:46 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:47 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d99be6-2fea-42d4-9040-a382c2580e95 -F qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9" returned: 0 in 0.310s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:47 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 is being set with open permissions: ugo+rw Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:47 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 Jul 28 16:46:47 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:47 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9" returned: 0 in 0.267s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:47 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.info Jul 28 16:46:47 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:47 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.info" returned: 0 in 0.267s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:47 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.info is being set with open permissions: ugo+rw Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.info {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:47 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.info Jul 28 16:46:47 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:47 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.info" returned: 0 in 0.257s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:47 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:47 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-cc751b05-d940-43ca-995d-3a1d469b2f3e tempest-SnapshotDependencyTests-1516399586 None] Create snapshot completed successfully Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88286) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Flow 'volume_create_manager' (ac7fd1b8-6703-4017-8a3e-af9c1800859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667395d1-bd56-4951-beba-fb97bc610c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667395d1-bd56-4951-beba-fb97bc610c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T14:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afc3761-87b5-4258-bf16-c6a95ef1a7d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d578afa65a454a0590c73b5ebf38c64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T14:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5652af00-75b5-45d0-b91d-227762df3dc9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T14:46:50Z,use_quota=True,user_id='3c79bdc28dc848cf8a6409b8ff7db593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df242364-bd66-4c26-888a-f60466b78abb),volume_type_id=df242364-bd66-4c26-888a-f60466b78abb)' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e14a31e-c4ea-49c2-bbc9-233e5555f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e14a31e-c4ea-49c2-bbc9-233e5555f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8436ead-933f-463f-bcd8-1d8b58a870ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8436ead-933f-463f-bcd8-1d8b58a870ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3afc3761-87b5-4258-bf16-c6a95ef1a7d9', 'volume_name': 'volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9', 'volume_size': 1, 'snapshot_id': '5652af00-75b5-45d0-b91d-227762df3dc9'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a40a39-212d-4e1a-b11b-593b9ca3f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a40a39-212d-4e1a-b11b-593b9ca3f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5904291-9e2b-4813-bacc-8cc28e407509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:49 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Volume 3afc3761-87b5-4258-bf16-c6a95ef1a7d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9', 'volume_size': 1, 'snapshot_id': '5652af00-75b5-45d0-b91d-227762df3dc9'} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-quobyte-5652af00-75b5-45d0-b91d-227762df3dc9-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" by "_create_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-5652af00-75b5-45d0-b91d-227762df3dc9-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Creating volume 3afc3761-87b5-4258-bf16-c6a95ef1a7d9 from snapshot 5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Selected osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff as target Quobyte volume. {{(pid=88286) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-quobyte-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" by "_copy_volume_from_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] snapshot: 5652af00-75b5-45d0-b91d-227762df3dc9, volume: 3afc3761-87b5-4258-bf16-c6a95ef1a7d9, {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[a761d543-6889-4bcf-acab-444a66dcc41e]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:49 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:50 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 Jul 28 16:46:50 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:50 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9" returned: 0 in 0.389s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8d99be6-2fea-42d4-9040-a382c2580e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Creating direct copy from snapshot {{(pid=88286) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2326966-2150-4162-9d30-6308c5a49aa8]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:50 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 Jul 28 16:46:50 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:50 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95" returned: 0 in 0.399s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG cinder.utils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Path /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 not found in is_blk_device check {{(pid=88286) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 16:46:50 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:50 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 Jul 28 16:46:50 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:54 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" returned: 0 in 4.028s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:54 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f06fae3-f8f3-4eb7-b8a3-8de7f431e3d2]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:54 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:54 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 Jul 28 16:46:54 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:55 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95" returned: 0 in 0.582s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG cinder.image.image_utils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 {{(pid=88286) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 16:46:55 devstack cinder-volume[88286]: INFO cinder.image.image_utils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Converted 1024.00 MB image at 254.09 MB/s Jul 28 16:46:55 devstack cinder-volume[88286]: WARNING cinder.volume.drivers.remotefs [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 is being set with open permissions: ugo+rw Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:55 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 Jul 28 16:46:55 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:55 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" returned: 0 in 0.258s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" released by "_copy_volume_from_snapshot" :: held 5.753s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-5652af00-75b5-45d0-b91d-227762df3dc9-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" released by "_create_volume_from_snapshot" :: held 5.789s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.807s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5904291-9e2b-4813-bacc-8cc28e407509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9', 'volume_size': 1, 'snapshot_id': '5652af00-75b5-45d0-b91d-227762df3dc9'}' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1056f9-6f2c-4414-8c86-2f8fe79d8019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 16:46:55 devstack cinder-volume[88286]: INFO cinder.volume.flows.manager.create_volume [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Volume volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 (3afc3761-87b5-4258-bf16-c6a95ef1a7d9): created successfully Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1056f9-6f2c-4414-8c86-2f8fe79d8019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88286) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 16:46:55 devstack cinder-volume[88286]: DEBUG cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Flow 'volume_create_manager' (ac7fd1b8-6703-4017-8a3e-af9c1800859c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88286) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 16:46:55 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-c7adbcab-a82b-48a9-8aa0-69bff4c0537f tempest-SnapshotDependencyTests-1516399586 None] Created volume successfully. Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-5652af00-75b5-45d0-b91d-227762df3dc9-delete_snapshot" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-5652af00-75b5-45d0-b91d-227762df3dc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-quobyte-a8d99be6-2fea-42d4-9040-a382c2580e95" by "delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-a8d99be6-2fea-42d4-9040-a382c2580e95" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-quobyte-5652af00-75b5-45d0-b91d-227762df3dc9" by "_delete_snapshot" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-5652af00-75b5-45d0-b91d-227762df3dc9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Deleting offline snapshot 5652af00-75b5-45d0-b91d-227762df3dc9 of volume a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] snapshot_file for this snap is: volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff47e7-93ba-40e6-83b5-a600e226cbf1]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:56 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 Jul 28 16:46:56 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:56 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9" returned: 0 in 0.424s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.remotefs [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8d99be6-2fea-42d4-9040-a382c2580e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88286) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fa6610-3e30-4ba9-b357-bbb7fbca9f19]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:56 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:57 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 Jul 28 16:46:57 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:57 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95" returned: 0 in 0.410s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:57 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 Jul 28 16:46:57 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:57 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9" returned: 0 in 0.398s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:57 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:57 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9 Jul 28 16:46:57 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:58 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95.5652af00-75b5-45d0-b91d-227762df3dc9" returned: 0 in 0.262s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-5652af00-75b5-45d0-b91d-227762df3dc9" released by "_delete_snapshot" :: held 1.617s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-a8d99be6-2fea-42d4-9040-a382c2580e95" released by "delete_snapshot" :: held 1.641s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Created reservations ['949b9587-4333-48a6-b9fd-6575d16d34cf', 'ccb412ff-d5b1-4f4d-a7d3-37ba42bee467', '74f09bf7-c5d3-4b25-93a2-ec8607fc64b7', 'b494a69d-975f-4631-8900-b8b4503e1546'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:46:58 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Delete snapshot completed successfully. Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-d6a9b9b0-8864-455e-a774-52c07541aac8 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-5652af00-75b5-45d0-b91d-227762df3dc9-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-a8d99be6-2fea-42d4-9040-a382c2580e95-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-a8d99be6-2fea-42d4-9040-a382c2580e95-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-quobyte-a8d99be6-2fea-42d4-9040-a382c2580e95" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-a8d99be6-2fea-42d4-9040-a382c2580e95" acquired by "delete_volume" :: waited 0.017s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30dd69f-2cfe-4d83-953c-779097f89fa9]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:58 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:58 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 Jul 28 16:46:58 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:59 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95" returned: 0 in 0.398s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:59 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95 Jul 28 16:46:59 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:59 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-a8d99be6-2fea-42d4-9040-a382c2580e95" returned: 0 in 0.294s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-a8d99be6-2fea-42d4-9040-a382c2580e95" released by "delete_volume" :: held 0.761s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Created reservations ['5e5f7f5a-ee9c-4a29-b4bf-a7d61ce6ac3a', '6730db1c-a3be-4e23-b5e9-4b03a20f5b31', '28921b8a-9b1b-45b5-b01a-cd5b57eb4cb6', 'fbefce76-34ee-43b6-9035-b6343f344232'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:59 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:46:59 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-3afc3761-87b5-4258-bf16-c6a95ef1a7d9-delete_volume" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-3afc3761-87b5-4258-bf16-c6a95ef1a7d9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "cinder-quobyte-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" by "delete_volume" {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 16:46:59 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.299s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" acquired by "delete_volume" :: waited 0.021s {{(pid=88286) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 16:46:59 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Deleted volume successfully. Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo.privsep.daemon [-] privsep: reply[7184ebc5-f612-434d-a629-2cf278c71682]: (4, 'qcow2') {{(pid=89809) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:46:59 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-199760ed-c3a8-427d-ba9c-febf8f6fa97f tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-a8d99be6-2fea-42d4-9040-a382c2580e95-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:47:00 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 Jul 28 16:47:00 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:47:00 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" returned: 0 in 0.394s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:47:00 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9 Jul 28 16:47:00 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:47:00 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19/volume-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" returned: 0 in 0.271s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-quobyte-3afc3761-87b5-4258-bf16-c6a95ef1a7d9" released by "delete_volume" :: held 0.709s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG cinder.quota [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Created reservations ['1db5c198-c769-4025-a803-dab917ff83c4', '97552f95-6589-4900-a23e-2227fa3ce6a4', '8ab47040-e917-4cfb-a27d-e835998861b9', 'f3ef6fe6-c3c3-4dca-bb00-5ba986e4c353'] {{(pid=88286) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff': None} {{(pid=88286) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG cinder.volume.drivers.quobyte [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0bd06f21-1076-4c9c-8036-7528cd423bff'] {{(pid=88286) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.lockutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88286) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 16:47:00 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 16:47:00 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19 Jul 28 16:47:00 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 16:47:01 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 28 16:47:01 devstack cinder-volume[88286]: DEBUG oslo_concurrency.processutils [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf7d03be1bcdfdb973da8c6fcf18d19" returned: 0 in 0.309s {{(pid=88286) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 16:47:01 devstack cinder-volume[88286]: DEBUG cinder.manager [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Notifying Schedulers of capabilities ... {{(pid=88286) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 16:47:01 devstack cinder-volume[88286]: INFO cinder.volume.manager [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Deleted volume successfully. Jul 28 16:47:01 devstack cinder-volume[88286]: DEBUG cinder.coordination [None req-70f80a8c-0165-4db8-aa22-6ddf04955fa3 tempest-SnapshotDependencyTests-1516399586 None] Lock "cinder-3afc3761-87b5-4258-bf16-c6a95ef1a7d9-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88286) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 16:47:10 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:SELECT=21,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 16:47:11 devstack cinder-volume[88286]: DEBUG dbcounter [-] [88286] Writing DB stats cinder:UPDATE=24,cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}